-- Logs begin at Sat 2022-03-05 02:11:47 UTC, end at Sat 2022-03-05 03:11:48 UTC. -- Mar 05 02:43:30.790943 dv-cinder-827259-3-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Mar 05 02:43:30.800215 dv-cinder-827259-3-iscsi devstack@n-api.service[109112]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Mar 05 02:43:30.802596 dv-cinder-827259-3-iscsi devstack@n-api.service[109112]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sat Mar 5 02:43:30 2022] *** Mar 05 02:43:30.802596 dv-cinder-827259-3-iscsi devstack@n-api.service[109112]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Mar 05 02:43:30.802596 dv-cinder-827259-3-iscsi devstack@n-api.service[109112]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Mar 05 02:43:30.802596 dv-cinder-827259-3-iscsi devstack@n-api.service[109112]: nodename: dv-cinder-827259-3-iscsi Mar 05 02:43:30.802596 dv-cinder-827259-3-iscsi devstack@n-api.service[109112]: machine: x86_64 Mar 05 02:43:30.802596 dv-cinder-827259-3-iscsi devstack@n-api.service[109112]: clock source: unix Mar 05 02:43:30.802596 dv-cinder-827259-3-iscsi devstack@n-api.service[109112]: pcre jit disabled Mar 05 02:43:30.802596 dv-cinder-827259-3-iscsi devstack@n-api.service[109112]: detected number of CPU cores: 4 Mar 05 02:43:30.802596 dv-cinder-827259-3-iscsi devstack@n-api.service[109112]: current working directory: / Mar 05 02:43:30.802596 dv-cinder-827259-3-iscsi devstack@n-api.service[109112]: detected binary path: /usr/bin/uwsgi-core Mar 05 02:43:30.803368 dv-cinder-827259-3-iscsi devstack@n-api.service[109112]: your processes number limit is 47680 Mar 05 02:43:30.803368 dv-cinder-827259-3-iscsi devstack@n-api.service[109112]: your memory page size is 4096 bytes Mar 05 02:43:30.803368 dv-cinder-827259-3-iscsi devstack@n-api.service[109112]: detected max file descriptor number: 2048 Mar 05 02:43:30.803368 dv-cinder-827259-3-iscsi devstack@n-api.service[109112]: lock engine: pthread robust mutexes Mar 05 02:43:30.803368 dv-cinder-827259-3-iscsi devstack@n-api.service[109112]: thunder lock: enabled Mar 05 02:43:30.803368 dv-cinder-827259-3-iscsi devstack@n-api.service[109112]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Mar 05 02:43:30.803368 dv-cinder-827259-3-iscsi devstack@n-api.service[109112]: Python version: 3.8.10 (default, Nov 26 2021, 20:14:08) [GCC 9.3.0] Mar 05 02:43:30.846632 dv-cinder-827259-3-iscsi devstack@n-api.service[109112]: Python main interpreter initialized at 0x55ad2c93e9c0 Mar 05 02:43:30.846632 dv-cinder-827259-3-iscsi devstack@n-api.service[109112]: python threads support enabled Mar 05 02:43:30.846632 dv-cinder-827259-3-iscsi devstack@n-api.service[109112]: your server socket listen backlog is limited to 100 connections Mar 05 02:43:30.846632 dv-cinder-827259-3-iscsi devstack@n-api.service[109112]: your mercy for graceful operations on workers is 90 seconds Mar 05 02:43:30.846958 dv-cinder-827259-3-iscsi devstack@n-api.service[109112]: mapped 403077 bytes (393 KB) for 2 cores Mar 05 02:43:30.847036 dv-cinder-827259-3-iscsi devstack@n-api.service[109112]: *** Operational MODE: preforking *** Mar 05 02:43:30.847289 dv-cinder-827259-3-iscsi devstack@n-api.service[109112]: *** uWSGI is running in multiple interpreter mode *** Mar 05 02:43:30.847289 dv-cinder-827259-3-iscsi devstack@n-api.service[109112]: spawned uWSGI master process (pid: 109112) Mar 05 02:43:30.847476 dv-cinder-827259-3-iscsi systemd[1]: Started Devstack devstack@n-api.service. Mar 05 02:43:30.849990 dv-cinder-827259-3-iscsi devstack@n-api.service[109112]: spawned uWSGI worker 1 (pid: 109113, cores: 1) Mar 05 02:43:30.849990 dv-cinder-827259-3-iscsi devstack@n-api.service[109112]: spawned uWSGI worker 2 (pid: 109114, cores: 1) Mar 05 02:43:30.849990 dv-cinder-827259-3-iscsi devstack@n-api.service[109112]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Mar 05 02:43:32.685460 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Mar 05 02:43:32.685460 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: from cryptography.utils import int_from_bytes Mar 05 02:43:32.686039 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Mar 05 02:43:32.686039 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: from cryptography.utils import int_from_bytes Mar 05 02:43:32.686165 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Mar 05 02:43:32.686165 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: from cryptography.utils import int_from_bytes Mar 05 02:43:32.686594 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Mar 05 02:43:32.686594 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: from cryptography.utils import int_from_bytes Mar 05 02:43:35.271908 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Mar 05 02:43:35.272549 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Mar 05 02:43:35.272653 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Mar 05 02:43:35.272991 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Mar 05 02:43:35.273247 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Mar 05 02:43:35.273635 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:43:35.273984 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:43:35.274304 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:43:35.274554 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Mar 05 02:43:35.274920 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:43:35.275014 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Mar 05 02:43:35.275096 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:43:35.275246 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:43:35.275384 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Mar 05 02:43:35.275568 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:43:35.275770 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Mar 05 02:43:35.275891 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:43:35.276082 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Mar 05 02:43:35.276230 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:43:35.276495 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:43:35.276582 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:43:35.276812 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:43:35.276899 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:43:35.277140 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-827259-3-iscsi {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:43:35.277235 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:43:35.277468 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:43:35.277566 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:43:35.277775 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:43:35.277932 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:43:35.278121 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:43:35.278320 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:43:35.278455 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:43:35.278688 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:43:35.278783 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:43:35.279052 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:43:35.279141 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:43:35.279360 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:43:35.279458 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:43:35.279713 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:43:35.279873 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:43:35.280076 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:43:35.280304 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:43:35.280467 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-827259-3-iscsi {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:43:35.280632 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:43:35.280821 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:43:35.280918 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:43:35.281203 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:43:35.281315 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:43:35.281543 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:43:35.281646 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:43:35.281852 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:43:35.281969 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:43:35.282250 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:43:35.282338 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:43:35.282581 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:43:35.282676 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:43:35.282910 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:43:35.283005 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:43:35.283223 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:43:35.283484 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:43:35.283657 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-827259-3-iscsi {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:43:35.283830 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:43:35.283925 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:43:35.284172 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:43:35.284273 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:43:35.284515 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:43:35.284603 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:43:35.284863 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:43:35.284952 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:43:35.285711 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:43:35.285990 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:43:35.286091 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:43:35.286379 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:43:35.286473 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:43:35.286693 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:43:35.286791 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:43:35.287023 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:43:35.287111 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:43:35.287376 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:43:35.287472 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:43:35.287737 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:43:35.287918 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-827259-3-iscsi {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:43:35.288081 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:43:35.288180 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:43:35.288382 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:43:35.288477 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:43:35.288708 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:43:35.288806 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:43:35.289014 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:43:35.289286 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:43:35.289382 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:43:35.289623 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:43:35.289732 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:43:35.289948 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:43:35.290072 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:43:35.290278 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:43:35.290367 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:43:35.290587 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:43:35.290732 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:43:35.290980 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:43:35.291153 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:43:35.291295 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:43:35.291428 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:43:35.291609 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:43:35.291761 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:43:35.291934 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:43:35.292083 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:43:35.292261 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:43:35.292414 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:43:35.292556 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:43:35.292697 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:43:35.292841 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:43:35.292983 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:43:35.293125 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:43:35.293260 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:43:35.293399 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:43:35.293553 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:43:35.293701 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:43:35.293844 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:43:35.294012 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:43:35.294160 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:43:35.294295 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:43:35.294435 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:43:35.294577 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:43:35.294718 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:43:35.294884 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:43:35.295025 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:43:35.295191 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:43:35.295340 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:43:35.295485 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:43:35.295674 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:43:35.295817 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:43:35.295951 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:43:35.296093 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:43:35.296243 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:43:35.296406 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:43:35.296552 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:43:35.296731 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:43:35.296908 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:43:35.297064 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:43:35.297258 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:43:35.297406 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:43:35.297612 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:43:35.297848 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.26 {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:43:35.298011 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:43:35.298222 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.26 {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:43:35.298361 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:43:35.298508 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:43:35.298685 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:43:35.298827 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:43:35.299025 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:43:35.299175 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:43:35.299368 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:43:35.299527 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:43:35.299694 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:43:35.299843 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:43:35.300016 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:43:35.300169 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:43:35.300414 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:43:35.300566 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:43:35.300798 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:43:35.301710 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:43:35.302202 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:43:35.302614 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.26 {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:43:35.302897 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.26 {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:43:35.303253 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:43:35.303641 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:43:35.304001 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:43:35.304366 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:43:35.304750 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:43:35.305103 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:43:35.305427 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:43:35.305568 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:43:35.305763 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:43:35.306071 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:43:35.306222 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:43:35.306359 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:43:35.306502 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:43:35.306654 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:43:35.306788 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:43:35.306934 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:43:35.307076 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:43:35.307216 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:43:35.307349 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:43:35.307483 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:43:35.307625 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:43:35.307759 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:43:35.307948 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:43:35.308091 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:43:35.308266 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:43:35.308413 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:43:35.308647 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:43:35.308786 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:43:35.308927 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:43:35.309062 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:43:35.309385 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:43:35.309696 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:43:35.310060 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:43:35.310400 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:43:35.310752 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:43:35.311085 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:43:35.311430 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:43:35.311781 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:43:35.312121 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:43:35.312444 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:43:35.312781 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:43:35.312922 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:43:35.313129 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:43:35.313270 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:43:35.313497 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:43:35.313646 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:43:35.313825 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:43:35.313988 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:43:35.314170 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:43:35.314322 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:43:35.314489 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:43:35.314630 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:43:35.314806 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:43:35.314948 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:43:35.315141 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:43:35.315330 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:43:35.315559 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:43:35.315713 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:43:35.315901 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:43:35.316045 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:43:35.316254 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:43:35.316429 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:43:35.316629 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:43:35.316778 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:43:35.316963 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:43:35.317171 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:43:35.317469 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:43:35.317621 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:43:35.317797 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:43:35.317947 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:43:35.318149 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:43:35.318296 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:43:35.318477 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:43:35.318695 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:43:35.318832 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:43:35.318968 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:43:35.319118 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:43:35.319275 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:43:35.319410 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:43:35.319562 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:43:35.319726 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:43:35.319875 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:43:35.320041 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:43:35.320182 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:43:35.320368 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:43:35.320519 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:43:35.320682 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:43:35.320824 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:43:35.320994 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:43:35.321148 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:43:35.321321 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:43:35.321523 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:43:35.321684 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:43:35.321856 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:43:35.322022 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:43:35.322236 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:43:35.322389 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:43:35.322549 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:43:35.322697 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:43:35.322859 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:43:35.322999 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:43:35.323168 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:43:35.323406 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:43:35.323560 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:43:35.323695 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:43:35.323842 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:43:35.323982 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:43:35.324118 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:43:35.324261 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:43:35.324397 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:43:35.324599 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:43:35.324746 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:43:35.324937 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:43:35.325076 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.325263 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:43:35.325404 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.325586 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:43:35.325727 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.325895 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:43:35.326088 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.326226 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:43:35.326362 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.326532 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:43:35.326728 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.326870 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:43:35.327079 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.327221 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.327444 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.327595 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.327789 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.327929 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.328140 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.328280 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.328472 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.328611 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.328804 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.328951 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.329126 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.329266 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.329442 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.329583 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.329759 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.329909 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.330113 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.330300 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.330443 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.330586 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.330727 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.330903 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.331045 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.331248 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.331403 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.331589 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.331741 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.331933 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.332254 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.332405 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.332548 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.332764 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.332911 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.333087 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.333230 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.333403 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.333553 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.333722 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.333863 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.334088 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.334240 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.334414 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.334564 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.334729 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.334917 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.335069 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.335261 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.335463 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.335599 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.335734 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.335949 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.336098 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.336306 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.336448 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.336637 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.336784 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.336952 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.337095 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.337264 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.337405 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.337582 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.337722 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.337902 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.338084 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.338230 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.338364 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.338546 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.338686 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.338859 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.339008 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.339173 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.339313 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.339483 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.339637 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.339794 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.339942 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.340103 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.340294 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.340441 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.340625 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.340766 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.340980 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.341122 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.341300 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.341442 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.341618 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.341760 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.341944 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.342115 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.342281 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.342438 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.342651 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.342788 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.342930 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.343066 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.343200 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.343341 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.343477 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.343675 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.343822 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.344050 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.344192 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.344371 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.344535 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.344701 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.344850 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.345008 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.345150 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.345345 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.345494 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.345637 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.345771 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.345948 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.346143 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.346307 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.346457 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.346634 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.346790 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.346933 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.347081 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.347282 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.347426 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.347574 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.348230 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.348376 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.348619 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.348885 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.349031 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.349177 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.349319 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.349455 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.349599 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.349734 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.349869 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.350041 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.350190 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.350325 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.350475 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.350611 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.350745 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.350893 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.351042 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.351185 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.351357 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.351506 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.351648 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.351818 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.351964 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.352108 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.352273 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.352415 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.352585 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.352727 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.352916 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.353075 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.353247 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.353395 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.353538 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.353673 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.353861 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.354070 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.354213 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.354347 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.354510 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.354653 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.354796 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.354941 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.355106 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.355248 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.355410 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.355551 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.355699 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.355835 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.356006 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.356154 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.356312 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.356452 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.356595 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.356730 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.356901 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.357043 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.357202 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.357343 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.357485 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.357627 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.357789 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.357931 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.358400 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.358561 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.358747 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.358894 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.359041 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.359193 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.359334 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.359486 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.359634 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.359775 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.359917 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.360058 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.360198 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.360346 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.360520 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.360669 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.360856 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.361009 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.361166 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.361316 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.361480 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.361629 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.361791 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.361948 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.362144 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.362287 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.362428 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.362568 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.362716 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.362864 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.363019 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.363178 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.363904 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.364199 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.364348 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.364489 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.364643 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.364784 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.364931 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.365074 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.365214 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.365361 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.365511 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.365662 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.365803 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.365943 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.366117 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.366258 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.366410 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.366559 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.366701 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.366841 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.366982 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.367130 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.367280 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.367422 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.367573 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.367713 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.367877 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.368035 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.368176 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.368318 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.368482 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.368645 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.368787 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.368936 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.369084 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.369226 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.369367 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.369518 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.369659 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.369808 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.369988 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.370141 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.370283 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.370425 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.370576 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.370726 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.370889 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.371046 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.371204 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.371348 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.371512 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.371654 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.371795 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.372022 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.372169 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.372318 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.372536 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.372746 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.372910 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.373053 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.373194 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.373335 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.373486 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.373638 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.373779 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.373920 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.374102 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.374246 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.374399 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.374543 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.374684 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.374824 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.374965 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.375113 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.375255 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.375405 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.375548 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.375688 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.375828 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.375981 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.376123 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.376264 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.376405 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.376552 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.376694 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.376843 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.376986 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.377127 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.377278 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.377454 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.377609 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.377764 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.377914 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.378120 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.378271 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.378413 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.378562 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.378705 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.378846 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.379016 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.379166 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.379318 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.379588 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.379745 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.379887 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.380027 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.380168 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.380308 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.380463 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.380614 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.380755 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.380898 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.381045 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.381191 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.381352 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.381494 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.381634 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.381775 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.381923 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.382101 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.382246 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.382387 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.382527 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.382668 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.382815 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.382965 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.383113 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.383271 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.383499 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.383641 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.383789 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.383941 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.384091 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.384232 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.384373 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.384514 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.384654 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.384803 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.384944 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.385106 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.385254 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.385403 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.385557 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.385699 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.385839 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.386027 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.386177 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.386318 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.386475 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.386625 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.386767 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.386907 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.387058 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.387207 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.387361 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.387510 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.387675 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.387824 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.387990 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.388140 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.388289 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.388431 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.388598 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.388747 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.388920 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.389186 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.389491 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.389640 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.389817 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.389997 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.390148 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.390301 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.390470 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.390629 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.390777 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.390926 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.391105 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.391277 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.391425 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.391565 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.391756 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.391904 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.392045 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.392199 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.392354 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.392496 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.392646 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.392799 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.392943 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.393084 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.393236 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.393387 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.393536 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.393678 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.393820 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.393995 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.394147 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.394299 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.394443 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.394635 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.394780 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.394921 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.395091 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.395260 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.395403 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.395546 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.395687 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.395827 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.396050 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.396194 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.396342 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.396490 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.396633 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.396773 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.396922 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.397063 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.397215 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.397362 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.397504 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.397646 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.397795 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.397944 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.398122 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.398263 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.398413 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.398554 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.398704 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.398847 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.398998 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.399146 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.399294 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.399445 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.399610 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.399754 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.399942 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.400091 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.400231 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.400403 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.400560 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.400703 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.400851 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.401003 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.401153 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.401318 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.401461 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.401629 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.401773 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.401920 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.402115 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.402270 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.402419 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.402566 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.402708 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.402856 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.403020 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.403171 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.403313 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.403454 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.403617 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.403766 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.403918 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.404059 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.404200 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.404340 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.404481 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.404621 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.404775 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.404928 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.405076 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.405217 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.405358 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.405524 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.405675 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.405816 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.405986 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.406135 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.406277 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.406428 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.406570 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.406721 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.406863 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.407003 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.407150 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.407300 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.407471 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.407614 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.407755 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.407896 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.408036 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.408186 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.408335 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.408476 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.408646 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.408839 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.408985 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.409136 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.409278 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.409446 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.409596 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.409738 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.409887 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.410096 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.410782 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.410926 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.411067 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.411220 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.411375 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.411518 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.411665 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.411810 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.411964 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.412114 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.412265 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.412407 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.412547 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.412689 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.412829 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.412970 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.413129 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.413278 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.413421 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.413562 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.413711 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.413860 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.414034 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.414183 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.414325 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.414467 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.414607 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.414757 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.414906 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.415064 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.415206 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.415354 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.415497 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.415646 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.415787 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.415928 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.416069 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.416217 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.416358 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.416508 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.416650 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.416801 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.416942 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.417082 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.417231 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.417379 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.417522 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.417663 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.417804 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.417945 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.418136 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.418280 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.418421 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.418562 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.418713 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.418853 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.419005 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.419148 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.419288 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.419429 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.419596 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.419753 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.419939 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.420090 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.420264 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.420413 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.420562 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.420724 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.420873 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.421016 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.421180 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.421327 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.421468 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.421630 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.421774 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.421914 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.422098 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.422240 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.422395 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.422545 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.422700 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.422842 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.422990 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.423138 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.423303 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.423465 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.423614 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.423756 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.423934 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.424083 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.424224 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.424439 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.424584 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.424742 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.424885 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.425025 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.425174 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.425316 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.425462 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.425603 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.425752 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.426520 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.426687 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.426830 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.426973 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.427161 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.427319 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.427483 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.427641 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.427784 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.427924 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.428105 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.428256 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.428404 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.428553 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.428695 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.428836 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.428976 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.429135 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.429289 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.429431 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.429604 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.429753 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.429893 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.430079 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.430236 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.430379 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.430527 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.430677 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.430819 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.430959 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.431119 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.431262 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.431464 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.431619 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.431765 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.431915 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.432057 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.432205 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.432369 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.432525 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.432708 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.432869 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.433022 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.433163 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.433304 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.433445 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.433620 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.433783 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.433926 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.434125 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.434350 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.434499 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.434661 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.434821 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.434964 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.435115 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.435256 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.435397 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.435559 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.435716 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.435859 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.436006 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.436147 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.436345 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.436509 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.436659 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.436801 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.436941 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.437092 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.437233 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.437386 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.437530 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.437670 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.437811 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.437997 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.438146 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.438299 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.438441 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.438667 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.438817 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.438963 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.439114 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.439264 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.439406 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.439615 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.439770 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.439965 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.440121 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.440263 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.440410 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.440582 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.440731 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.440906 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.441073 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.441222 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.441364 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.441597 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.441748 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.442018 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.442183 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.442352 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.442501 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.442687 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.442912 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.443065 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.443208 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.443360 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.443514 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.443656 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.443804 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.443945 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.444094 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.444235 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.444385 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.444528 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.444669 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.444844 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.444993 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.445142 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.445295 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.445468 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.445679 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.445829 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.446025 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.446189 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.446332 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.446473 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.446658 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.446860 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.447012 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.447189 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.447351 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.447492 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.447640 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.447821 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.447980 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.448152 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.448301 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.448442 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.448582 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.448759 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.448916 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.449065 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.449206 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.449357 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.449499 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.449640 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.449789 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.449931 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.450121 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.450274 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.450416 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.450556 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.450706 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.450849 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.450990 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.451131 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.451281 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.451455 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.451617 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.451759 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.451933 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.452094 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.452241 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.452395 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.452537 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.452677 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.452818 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.452992 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.453143 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.453303 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.453446 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.453588 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.453728 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.453868 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.454050 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.454213 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.454357 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.454526 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.454676 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.454817 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.454957 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.455142 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.455294 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.455472 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.455628 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.455802 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.455959 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.456109 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.456258 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.456430 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.456579 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.456754 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.456910 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.457091 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.457258 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.457452 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.457607 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.457795 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.458007 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.458158 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.458299 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.458440 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.458581 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.458768 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.458917 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.459066 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.459215 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.459373 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.459517 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.459667 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.459809 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.459951 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.460098 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.460240 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.460387 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.460538 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.460680 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.460821 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.460961 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.461102 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.461253 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.461404 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.461547 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.461689 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.461830 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.461992 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.462164 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.462311 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.462453 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.462595 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.462736 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.462876 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.463043 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.463187 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.463328 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.463476 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.463619 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.463760 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.463910 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.464079 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.464229 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.464404 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.464554 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.464731 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.464889 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.465042 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.465184 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.465355 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.465505 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.465677 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.465826 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.466023 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.466173 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.466315 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.466456 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.466631 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.466791 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.466941 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.467095 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.467238 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.467378 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.467532 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.467681 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.467831 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.467973 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.468144 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.468301 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.468452 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.468601 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.468749 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.468891 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.469120 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.469269 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.469442 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.469592 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.469760 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.469910 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.470105 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.470267 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.470513 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.470661 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.470826 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.470976 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.471128 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.471278 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.471422 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.471563 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.471733 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.471898 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.472108 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.472281 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.472443 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.472594 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.473371 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.473474 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.473573 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.473660 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.473800 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.473942 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.474162 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.474320 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.474558 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.474710 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.474885 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.475033 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.475201 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.475358 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.475510 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.475662 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.475863 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.476017 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.476180 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.476342 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.476485 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.476627 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.476791 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.476946 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.477094 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.477244 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.477406 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.477583 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.477729 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.477878 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.478058 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.478204 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.478345 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.478494 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.478635 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.478782 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.478932 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.479074 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.479225 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.479367 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.479508 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.479649 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.479798 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.479940 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.480110 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.480260 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.480444 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.480605 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.480748 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.480889 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.481063 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.481223 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.481365 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.481517 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.481680 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.481829 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.482084 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.482265 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.482409 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.482561 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.482712 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.482855 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.483277 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.483439 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.483728 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.483877 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.484045 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.484193 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.484344 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.484485 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.484653 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.484797 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.484963 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.485121 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.485264 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.485405 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.485565 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.485709 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.485851 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.486049 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.486201 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.486363 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.486525 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.486667 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.486809 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.486973 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.487135 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.487286 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.487428 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.487579 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.487727 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.487892 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.488186 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.488583 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.488583 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.488887 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.489040 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.489183 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.489323 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.489566 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.489715 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.489877 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.490082 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.490229 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.490382 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.490526 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.490679 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.490822 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.490986 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.491136 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.491308 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.491459 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.491615 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.491759 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.491937 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.492088 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.492243 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.492387 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.492536 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.492678 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.492855 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.493005 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.493156 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.493309 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.493459 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.493610 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.493752 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.493926 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.494096 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.494253 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.494397 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.494538 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.494678 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.494828 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.494971 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.495112 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.495253 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.495401 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.495544 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.495768 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.495919 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.496062 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.496214 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.496356 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.496505 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.496657 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.496806 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.496948 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.497097 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.497239 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.497389 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.497532 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.497684 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.497826 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.498001 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.498151 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.498306 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.498449 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.498590 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.498730 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.498871 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.499013 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.499167 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.499323 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.499472 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.499634 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.499777 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.499926 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.500076 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.500219 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.500361 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.500502 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.500652 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.500793 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.500942 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.501085 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.501226 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.501368 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.501520 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.501670 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.501835 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.502010 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.502161 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.502336 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.502657 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.502885 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.503030 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.503172 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.503313 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.503454 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.503625 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.503795 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.504620 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.504783 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.504990 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.505161 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.505315 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.505458 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.505602 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.505743 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.505895 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.506090 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.506246 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.506409 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.506564 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.506708 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.506850 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.506991 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.507140 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.507290 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.507433 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.507574 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.507716 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.507857 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.508006 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.508148 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.508300 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.508467 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.508617 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.508768 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.508912 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.509078 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.509236 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.509386 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.509536 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.509688 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.509839 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.510028 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.510197 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.510341 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.510484 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.510637 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.510780 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.510922 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.511063 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.511204 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.511354 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.511537 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.511686 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.511828 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.511988 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.512139 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.512289 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.512432 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.512574 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.512725 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.512868 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.513046 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.513207 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.513351 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.513492 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.513633 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.513774 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.514007 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.514161 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.514303 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.514454 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.514632 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.514784 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.514949 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.515093 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.515234 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.515375 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.515586 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.515741 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.515906 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.516051 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.516199 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.516342 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.516511 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.516669 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.516818 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.516960 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.517136 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.517292 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.517480 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.517646 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.517807 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.517969 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.518121 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.518263 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.518433 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.518593 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.518736 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.518876 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.519025 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.519178 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.519340 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.519484 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.520197 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.520425 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.520576 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.520717 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.520867 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.521010 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.521174 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.521334 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.521477 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.521618 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.521769 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.521998 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.522167 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.522318 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.522473 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.522615 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.522769 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.522912 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.523053 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.523194 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.523335 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.523486 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.523630 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.523771 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.523920 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.524062 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.524214 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.524363 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.524507 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.524648 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.524790 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.524930 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.525095 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.525251 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.525394 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.525535 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.525676 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.525817 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.525980 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.526152 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.526296 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.526437 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.526580 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.526721 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.526870 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.527013 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.527154 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.527300 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.527441 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.527582 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.527738 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.527881 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.528032 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.528174 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.528326 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.528467 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.528618 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.528776 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.528919 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.529061 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.529210 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.529352 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.529501 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.529667 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.529817 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.530003 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.530164 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.530320 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.530463 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.530633 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.530791 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.530962 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.531112 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.531283 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.531433 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.531599 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.531749 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.531908 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.532050 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.532266 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.532411 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.532552 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.532693 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.532835 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.532985 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.533128 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.533276 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.533417 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.533567 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.533709 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.533868 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.534051 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.534207 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.534404 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.534553 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.534715 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.535058 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.535505 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.536220 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.536370 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.536515 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.536515 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.536811 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.536961 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.537105 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.537246 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.537451 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.537608 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.537752 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.537900 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.538103 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.538247 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.538400 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.538555 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.538710 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.538852 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.538852 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.539122 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.539272 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.539424 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.539566 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.539707 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.539848 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.539989 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.540139 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.540289 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.540440 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.540603 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.540746 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.540888 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.541037 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.541180 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.541180 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.541450 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.541591 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.541731 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.541881 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=109113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Mar 05 02:43:35.542047 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.542047 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.542300 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:43:35.542483 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=109114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Mar 05 02:43:35.563659 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG oslo_db.sqlalchemy.engines [None req-aff3a9f9-ebb8-40a2-9af0-5c8c4e0c95c6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109113) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 05 02:43:35.564658 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG oslo_db.sqlalchemy.engines [None req-9c388cf8-a5a8-4af4-8802-3519add9dab0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109114) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 05 02:43:35.627303 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.context [None req-aff3a9f9-ebb8-40a2-9af0-5c8c4e0c95c6 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),9d368175-6627-4876-8662-d12827d1bbec(cell1) {{(pid=109113) load_cells /opt/stack/nova/nova/context.py:464}} Mar 05 02:43:35.629584 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.context [None req-9c388cf8-a5a8-4af4-8802-3519add9dab0 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),9d368175-6627-4876-8662-d12827d1bbec(cell1) {{(pid=109114) load_cells /opt/stack/nova/nova/context.py:464}} Mar 05 02:43:35.632848 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG oslo_concurrency.lockutils [None req-aff3a9f9-ebb8-40a2-9af0-5c8c4e0c95c6 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:43:35.634441 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG oslo_concurrency.lockutils [None req-9c388cf8-a5a8-4af4-8802-3519add9dab0 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:43:35.634540 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG oslo_concurrency.lockutils [None req-aff3a9f9-ebb8-40a2-9af0-5c8c4e0c95c6 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:43:35.635239 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG oslo_concurrency.lockutils [None req-aff3a9f9-ebb8-40a2-9af0-5c8c4e0c95c6 None None] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:43:35.636023 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG oslo_concurrency.lockutils [None req-9c388cf8-a5a8-4af4-8802-3519add9dab0 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:43:35.636839 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG oslo_concurrency.lockutils [None req-9c388cf8-a5a8-4af4-8802-3519add9dab0 None None] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:43:35.637159 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG oslo_concurrency.lockutils [None req-aff3a9f9-ebb8-40a2-9af0-5c8c4e0c95c6 None None] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:43:35.638846 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG oslo_concurrency.lockutils [None req-9c388cf8-a5a8-4af4-8802-3519add9dab0 None None] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:43:35.649435 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG oslo_db.sqlalchemy.engines [None req-aff3a9f9-ebb8-40a2-9af0-5c8c4e0c95c6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109113) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 05 02:43:35.655136 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG oslo_db.sqlalchemy.engines [None req-9c388cf8-a5a8-4af4-8802-3519add9dab0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109114) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 05 02:43:35.657205 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG oslo_db.sqlalchemy.engines [None req-aff3a9f9-ebb8-40a2-9af0-5c8c4e0c95c6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109113) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 05 02:43:35.658159 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG oslo_db.sqlalchemy.engines [None req-9c388cf8-a5a8-4af4-8802-3519add9dab0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109114) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 05 02:43:35.811574 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG oslo_db.sqlalchemy.engines [None req-aff3a9f9-ebb8-40a2-9af0-5c8c4e0c95c6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109113) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 05 02:43:35.819068 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG oslo_db.sqlalchemy.engines [None req-9c388cf8-a5a8-4af4-8802-3519add9dab0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109114) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 05 02:43:36.147718 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: WARNING keystonemiddleware.auth_token [None req-aff3a9f9-ebb8-40a2-9af0-5c8c4e0c95c6 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Mar 05 02:43:36.149402 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: WARNING keystonemiddleware.auth_token [None req-9c388cf8-a5a8-4af4-8802-3519add9dab0 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Mar 05 02:43:36.154374 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: WARNING keystonemiddleware.auth_token [None req-aff3a9f9-ebb8-40a2-9af0-5c8c4e0c95c6 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Mar 05 02:43:36.156100 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: WARNING keystonemiddleware.auth_token [None req-9c388cf8-a5a8-4af4-8802-3519add9dab0 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Mar 05 02:43:36.494658 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: WARNING keystonemiddleware.auth_token [None req-aff3a9f9-ebb8-40a2-9af0-5c8c4e0c95c6 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Mar 05 02:43:36.499363 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: WARNING keystonemiddleware.auth_token [None req-9c388cf8-a5a8-4af4-8802-3519add9dab0 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Mar 05 02:43:36.499855 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: WARNING keystonemiddleware.auth_token [None req-aff3a9f9-ebb8-40a2-9af0-5c8c4e0c95c6 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Mar 05 02:43:36.505395 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: WARNING keystonemiddleware.auth_token [None req-9c388cf8-a5a8-4af4-8802-3519add9dab0 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Mar 05 02:43:36.505551 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55ad2c93e9c0 pid: 109113 (default app) Mar 05 02:43:36.507645 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi [None req-aff3a9f9-ebb8-40a2-9af0-5c8c4e0c95c6 None None] Calling method '>' {{(pid=109113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:43:36.508800 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: INFO nova.api.openstack.requestlog [None req-aff3a9f9-ebb8-40a2-9af0-5c8c4e0c95c6 None None] 10.222.0.26 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001737 Mar 05 02:43:36.509209 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: [pid: 109113|app: 0|req: 1/1] 10.222.0.26 () {50 vars in 788 bytes} [Sat Mar 5 02:43:36 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 02:43:36.510505 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55ad2c93e9c0 pid: 109114 (default app) Mar 05 02:44:57.976608 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi [None req-aff3a9f9-ebb8-40a2-9af0-5c8c4e0c95c6 None None] Calling method '>' {{(pid=109113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:44:57.978622 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: INFO nova.api.openstack.requestlog [None req-aff3a9f9-ebb8-40a2-9af0-5c8c4e0c95c6 None None] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002795 Mar 05 02:44:57.979553 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: [pid: 109113|app: 0|req: 2/2] 10.222.0.26 () {54 vars in 930 bytes} [Sat Mar 5 02:44:57 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 02:44:58.546871 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi [None req-f9f6bbb9-fbb2-4c83-93e5-2e9b426f9572 admin admin] Calling method '>' {{(pid=109114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:44:58.575613 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: INFO nova.api.openstack.requestlog [None req-f9f6bbb9-fbb2-4c83-93e5-2e9b426f9572 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.589097 Mar 05 02:44:58.576333 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: [pid: 109114|app: 0|req: 1/3] 10.222.0.26 () {60 vars in 1291 bytes} [Sat Mar 5 02:44:57 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 02:45:00.983752 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi [None req-aff3a9f9-ebb8-40a2-9af0-5c8c4e0c95c6 None None] Calling method '>' {{(pid=109113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:45:00.984902 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: INFO nova.api.openstack.requestlog [None req-aff3a9f9-ebb8-40a2-9af0-5c8c4e0c95c6 None None] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001449 Mar 05 02:45:00.985290 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: [pid: 109113|app: 0|req: 3/4] 10.222.0.26 () {54 vars in 930 bytes} [Sat Mar 5 02:45:00 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 02:45:01.046825 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi [None req-37183249-daad-4534-8d7c-2e757ede320c admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "c1", "name": "cirros256", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "ram": 256, "swap": 0, "disk": 1, "os-flavor-access:is_public": true}} {{(pid=109114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 02:45:01.066118 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 05 02:45:01.066118 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: warnings.warn(msg) Mar 05 02:45:01.094984 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: INFO nova.api.openstack.requestlog [None req-37183249-daad-4534-8d7c-2e757ede320c admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.103138 Mar 05 02:45:01.095967 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: [pid: 109114|app: 0|req: 2/5] 10.222.0.26 () {64 vars in 1282 bytes} [Sat Mar 5 02:45:00 2022] POST /compute/v2.1/flavors => generated 407 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 05 02:45:01.308986 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi [None req-7cd81044-d5b8-498f-a1c0-c45fb1ed9e15 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 02:45:01.311370 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 05 02:45:01.311370 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: warnings.warn(msg) Mar 05 02:45:01.361261 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: INFO nova.api.openstack.requestlog [None req-7cd81044-d5b8-498f-a1c0-c45fb1ed9e15 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.257063 Mar 05 02:45:01.362530 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: [pid: 109113|app: 0|req: 4/6] 10.222.0.26 () {64 vars in 1335 bytes} [Sat Mar 5 02:45:01 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 02:45:03.753884 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi [None req-37183249-daad-4534-8d7c-2e757ede320c admin admin] Calling method '>' {{(pid=109114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:45:03.754970 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: INFO nova.api.openstack.requestlog [None req-37183249-daad-4534-8d7c-2e757ede320c admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.004273 Mar 05 02:45:03.755548 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: [pid: 109114|app: 0|req: 3/7] 10.222.0.26 () {54 vars in 930 bytes} [Sat Mar 5 02:45:03 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 02:45:03.878250 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi [None req-b2fd3e6e-70ee-43ab-8c5c-ccb01f06c258 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "rxtx_factor": 1.0, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d1", "name": "ds512M", "disk": 5, "ram": 512, "swap": 0}} {{(pid=109113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 02:45:03.898761 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 05 02:45:03.898761 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: warnings.warn(msg) Mar 05 02:45:03.920041 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: INFO nova.api.openstack.requestlog [None req-b2fd3e6e-70ee-43ab-8c5c-ccb01f06c258 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.157937 Mar 05 02:45:03.920603 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: [pid: 109113|app: 0|req: 5/8] 10.222.0.26 () {64 vars in 1282 bytes} [Sat Mar 5 02:45:03 2022] POST /compute/v2.1/flavors => generated 404 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 05 02:45:03.932842 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi [None req-03e92583-8e15-48d2-b6d5-defb0182d733 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 02:45:03.934442 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 05 02:45:03.934442 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: warnings.warn(msg) Mar 05 02:45:03.970593 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: INFO nova.api.openstack.requestlog [None req-03e92583-8e15-48d2-b6d5-defb0182d733 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.041572 Mar 05 02:45:03.971340 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: [pid: 109114|app: 0|req: 4/9] 10.222.0.26 () {64 vars in 1335 bytes} [Sat Mar 5 02:45:03 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 02:45:06.341642 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi [None req-b2fd3e6e-70ee-43ab-8c5c-ccb01f06c258 admin admin] Calling method '>' {{(pid=109113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:45:06.342744 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: INFO nova.api.openstack.requestlog [None req-b2fd3e6e-70ee-43ab-8c5c-ccb01f06c258 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001547 Mar 05 02:45:06.343141 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: [pid: 109113|app: 0|req: 6/10] 10.222.0.26 () {54 vars in 930 bytes} [Sat Mar 5 02:45:06 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 02:45:06.406184 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi [None req-a1f8c5a5-70cd-41c2-9ccb-c449aee748ed admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "id": "d2", "name": "ds1G", "os-flavor-access:is_public": true, "ram": 1024, "disk": 10, "swap": 0, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=109114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 02:45:06.426748 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: INFO nova.api.openstack.requestlog [None req-a1f8c5a5-70cd-41c2-9ccb-c449aee748ed admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.077229 Mar 05 02:45:06.427845 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: [pid: 109114|app: 0|req: 5/11] 10.222.0.26 () {64 vars in 1282 bytes} [Sat Mar 5 02:45:06 2022] POST /compute/v2.1/flavors => generated 404 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 05 02:45:06.439071 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi [None req-8a49fc73-448d-4098-88a5-1106dd07e78c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 02:45:06.463723 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: INFO nova.api.openstack.requestlog [None req-8a49fc73-448d-4098-88a5-1106dd07e78c admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028313 Mar 05 02:45:06.464635 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: [pid: 109113|app: 0|req: 7/12] 10.222.0.26 () {64 vars in 1335 bytes} [Sat Mar 5 02:45:06 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 02:45:08.848600 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi [None req-a1f8c5a5-70cd-41c2-9ccb-c449aee748ed admin admin] Calling method '>' {{(pid=109114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:45:08.849602 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: INFO nova.api.openstack.requestlog [None req-a1f8c5a5-70cd-41c2-9ccb-c449aee748ed admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001690 Mar 05 02:45:08.850175 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: [pid: 109114|app: 0|req: 6/13] 10.222.0.26 () {54 vars in 930 bytes} [Sat Mar 5 02:45:08 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 02:45:08.911170 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi [None req-8f582197-ae74-4548-b38d-82ef14ebb5a1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "id": "d3", "name": "ds2G", "disk": 10, "swap": 0, "vcpus": 2, "ram": 2048, "rxtx_factor": 1.0}} {{(pid=109113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 02:45:08.930073 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: INFO nova.api.openstack.requestlog [None req-8f582197-ae74-4548-b38d-82ef14ebb5a1 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.074026 Mar 05 02:45:08.930556 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: [pid: 109113|app: 0|req: 8/14] 10.222.0.26 () {64 vars in 1282 bytes} [Sat Mar 5 02:45:08 2022] POST /compute/v2.1/flavors => generated 404 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 05 02:45:08.942689 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi [None req-7b7ac874-d613-4713-b541-81fde3bb8ed6 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 02:45:08.965596 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: INFO nova.api.openstack.requestlog [None req-7b7ac874-d613-4713-b541-81fde3bb8ed6 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026746 Mar 05 02:45:08.966584 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: [pid: 109114|app: 0|req: 7/15] 10.222.0.26 () {64 vars in 1335 bytes} [Sat Mar 5 02:45:08 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 02:45:11.333632 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi [None req-8f582197-ae74-4548-b38d-82ef14ebb5a1 admin admin] Calling method '>' {{(pid=109113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:45:11.334739 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: INFO nova.api.openstack.requestlog [None req-8f582197-ae74-4548-b38d-82ef14ebb5a1 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001531 Mar 05 02:45:11.335393 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: [pid: 109113|app: 0|req: 9/16] 10.222.0.26 () {54 vars in 930 bytes} [Sat Mar 5 02:45:11 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 02:45:11.393517 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi [None req-36247d91-1848-40b3-8dd4-edfba62e7a8f admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds4G", "swap": 0, "disk": 20, "ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "vcpus": 4, "os-flavor-access:is_public": true, "id": "d4"}} {{(pid=109114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 02:45:11.411844 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: INFO nova.api.openstack.requestlog [None req-36247d91-1848-40b3-8dd4-edfba62e7a8f admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.070478 Mar 05 02:45:11.412481 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: [pid: 109114|app: 0|req: 8/17] 10.222.0.26 () {64 vars in 1282 bytes} [Sat Mar 5 02:45:11 2022] POST /compute/v2.1/flavors => generated 404 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Mar 05 02:45:11.424849 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi [None req-aca263b5-1b6c-4b0f-a7a4-42d7a0ef2d01 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 02:45:11.446624 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: INFO nova.api.openstack.requestlog [None req-aca263b5-1b6c-4b0f-a7a4-42d7a0ef2d01 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026260 Mar 05 02:45:11.447531 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: [pid: 109113|app: 0|req: 10/18] 10.222.0.26 () {64 vars in 1335 bytes} [Sat Mar 5 02:45:11 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 02:45:13.847422 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi [None req-36247d91-1848-40b3-8dd4-edfba62e7a8f admin admin] Calling method '>' {{(pid=109114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:45:13.848426 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: INFO nova.api.openstack.requestlog [None req-36247d91-1848-40b3-8dd4-edfba62e7a8f admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001425 Mar 05 02:45:13.848842 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: [pid: 109114|app: 0|req: 9/19] 10.222.0.26 () {54 vars in 930 bytes} [Sat Mar 5 02:45:13 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 02:45:13.911342 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi [None req-40d81184-e920-496a-926f-0b9ab4451395 admin admin] Calling method '>' {{(pid=109113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:45:13.934098 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: INFO nova.api.openstack.requestlog [None req-40d81184-e920-496a-926f-0b9ab4451395 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.079192 Mar 05 02:45:13.934849 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: [pid: 109113|app: 0|req: 11/20] 10.222.0.26 () {60 vars in 1291 bytes} [Sat Mar 5 02:45:13 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 02:45:16.307962 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi [None req-36247d91-1848-40b3-8dd4-edfba62e7a8f admin admin] Calling method '>' {{(pid=109114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:45:16.308978 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: INFO nova.api.openstack.requestlog [None req-36247d91-1848-40b3-8dd4-edfba62e7a8f admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001443 Mar 05 02:45:16.309557 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: [pid: 109114|app: 0|req: 10/21] 10.222.0.26 () {54 vars in 930 bytes} [Sat Mar 5 02:45:16 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 02:45:16.367508 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi [None req-a04df8f3-de1e-46ad-8fbd-07c9eddd83b8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 1, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "name": "m1.tiny", "id": "1", "ram": 512, "vcpus": 1}} {{(pid=109113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 02:45:16.385408 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: INFO nova.api.openstack.requestlog [None req-a04df8f3-de1e-46ad-8fbd-07c9eddd83b8 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.070157 Mar 05 02:45:16.385938 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: [pid: 109113|app: 0|req: 12/22] 10.222.0.26 () {64 vars in 1282 bytes} [Sat Mar 5 02:45:16 2022] POST /compute/v2.1/flavors => generated 402 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 05 02:45:16.400338 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi [None req-a3bb4a9a-5b2e-44fb-8ae3-1b3ef68e381d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 02:45:16.426292 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: INFO nova.api.openstack.requestlog [None req-a3bb4a9a-5b2e-44fb-8ae3-1b3ef68e381d admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030777 Mar 05 02:45:16.426976 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: [pid: 109114|app: 0|req: 11/23] 10.222.0.26 () {64 vars in 1332 bytes} [Sat Mar 5 02:45:16 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 02:45:19.448966 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi [None req-a04df8f3-de1e-46ad-8fbd-07c9eddd83b8 admin admin] Calling method '>' {{(pid=109113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:45:19.450101 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: INFO nova.api.openstack.requestlog [None req-a04df8f3-de1e-46ad-8fbd-07c9eddd83b8 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001530 Mar 05 02:45:19.450587 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: [pid: 109113|app: 0|req: 13/24] 10.222.0.26 () {54 vars in 930 bytes} [Sat Mar 5 02:45:19 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 02:45:19.514391 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi [None req-0d956991-84f6-4c71-9929-439357424eb2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "ram": 2048, "disk": 20, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "rxtx_factor": 1.0, "name": "m1.small", "id": "2"}} {{(pid=109114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 02:45:19.533425 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: INFO nova.api.openstack.requestlog [None req-0d956991-84f6-4c71-9929-439357424eb2 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.076151 Mar 05 02:45:19.534196 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: [pid: 109114|app: 0|req: 12/25] 10.222.0.26 () {64 vars in 1282 bytes} [Sat Mar 5 02:45:19 2022] POST /compute/v2.1/flavors => generated 405 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Mar 05 02:45:19.546127 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi [None req-25536718-4d7a-444e-aab5-12041dab669c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 02:45:19.569617 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: INFO nova.api.openstack.requestlog [None req-25536718-4d7a-444e-aab5-12041dab669c admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027144 Mar 05 02:45:19.570442 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: [pid: 109113|app: 0|req: 14/26] 10.222.0.26 () {64 vars in 1332 bytes} [Sat Mar 5 02:45:19 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 02:45:21.899128 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi [None req-0d956991-84f6-4c71-9929-439357424eb2 admin admin] Calling method '>' {{(pid=109114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:45:21.900248 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: INFO nova.api.openstack.requestlog [None req-0d956991-84f6-4c71-9929-439357424eb2 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001536 Mar 05 02:45:21.900719 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: [pid: 109114|app: 0|req: 13/27] 10.222.0.26 () {54 vars in 930 bytes} [Sat Mar 5 02:45:21 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 02:45:21.957630 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi [None req-2bb17a63-5248-4132-86ed-658c04f75e39 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 40, "name": "m1.medium", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "3", "vcpus": 2, "ram": 4096, "swap": 0, "rxtx_factor": 1.0}} {{(pid=109113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 02:45:21.975230 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: INFO nova.api.openstack.requestlog [None req-2bb17a63-5248-4132-86ed-658c04f75e39 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.068825 Mar 05 02:45:21.975762 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: [pid: 109113|app: 0|req: 15/28] 10.222.0.26 () {64 vars in 1282 bytes} [Sat Mar 5 02:45:21 2022] POST /compute/v2.1/flavors => generated 406 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Mar 05 02:45:21.988019 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi [None req-3c3f7d65-d05a-482b-9285-cd454cafda82 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 02:45:22.009224 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: INFO nova.api.openstack.requestlog [None req-3c3f7d65-d05a-482b-9285-cd454cafda82 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.025359 Mar 05 02:45:22.009893 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: [pid: 109114|app: 0|req: 14/29] 10.222.0.26 () {64 vars in 1332 bytes} [Sat Mar 5 02:45:21 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 02:45:24.358682 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi [None req-2bb17a63-5248-4132-86ed-658c04f75e39 admin admin] Calling method '>' {{(pid=109113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:45:24.360429 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: INFO nova.api.openstack.requestlog [None req-2bb17a63-5248-4132-86ed-658c04f75e39 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002203 Mar 05 02:45:24.361811 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: [pid: 109113|app: 0|req: 16/30] 10.222.0.26 () {54 vars in 930 bytes} [Sat Mar 5 02:45:24 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 02:45:24.424125 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi [None req-8cf3fd00-310b-4245-88c8-d5790d5abed4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 8192, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "id": "4", "disk": 80, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.large", "swap": 0, "vcpus": 4}} {{(pid=109114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 02:45:24.446142 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: INFO nova.api.openstack.requestlog [None req-8cf3fd00-310b-4245-88c8-d5790d5abed4 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.076096 Mar 05 02:45:24.446142 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: [pid: 109114|app: 0|req: 15/31] 10.222.0.26 () {64 vars in 1282 bytes} [Sat Mar 5 02:45:24 2022] POST /compute/v2.1/flavors => generated 405 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 05 02:45:24.455783 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi [None req-d3fcffde-fc6b-483b-acd0-766ad2c74ca3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 02:45:24.480912 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: INFO nova.api.openstack.requestlog [None req-d3fcffde-fc6b-483b-acd0-766ad2c74ca3 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028787 Mar 05 02:45:24.481502 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: [pid: 109113|app: 0|req: 17/32] 10.222.0.26 () {64 vars in 1332 bytes} [Sat Mar 5 02:45:24 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 02:45:26.865809 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi [None req-8cf3fd00-310b-4245-88c8-d5790d5abed4 admin admin] Calling method '>' {{(pid=109114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:45:26.866872 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: INFO nova.api.openstack.requestlog [None req-8cf3fd00-310b-4245-88c8-d5790d5abed4 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001501 Mar 05 02:45:26.867890 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: [pid: 109114|app: 0|req: 16/33] 10.222.0.26 () {54 vars in 930 bytes} [Sat Mar 5 02:45:26 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 02:45:26.927562 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi [None req-c71713ca-dc10-41c7-b0e0-ec2c37ae3824 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "5", "name": "m1.xlarge", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 16384, "os-flavor-access:is_public": true, "disk": 160, "rxtx_factor": 1.0, "swap": 0, "vcpus": 8}} {{(pid=109113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 02:45:26.945454 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: INFO nova.api.openstack.requestlog [None req-c71713ca-dc10-41c7-b0e0-ec2c37ae3824 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.072440 Mar 05 02:45:26.946623 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: [pid: 109113|app: 0|req: 18/34] 10.222.0.26 () {64 vars in 1282 bytes} [Sat Mar 5 02:45:26 2022] POST /compute/v2.1/flavors => generated 408 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Mar 05 02:45:26.958180 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi [None req-9ee73837-b8a6-41f7-981d-27a7a2454be8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 02:45:26.984078 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: INFO nova.api.openstack.requestlog [None req-9ee73837-b8a6-41f7-981d-27a7a2454be8 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029820 Mar 05 02:45:26.985122 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: [pid: 109114|app: 0|req: 17/35] 10.222.0.26 () {64 vars in 1332 bytes} [Sat Mar 5 02:45:26 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 02:45:50.388800 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi [None req-c71713ca-dc10-41c7-b0e0-ec2c37ae3824 admin admin] Calling method '>' {{(pid=109113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:45:50.389799 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: INFO nova.api.openstack.requestlog [None req-c71713ca-dc10-41c7-b0e0-ec2c37ae3824 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001416 Mar 05 02:45:50.390219 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: [pid: 109113|app: 0|req: 19/36] 10.222.0.26 () {54 vars in 930 bytes} [Sat Mar 5 02:45:50 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 02:45:50.446582 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi [None req-8a2636da-c1a2-465a-b3b9-311b09598f41 admin admin] Calling method '>' {{(pid=109114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:45:50.463309 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: INFO nova.api.openstack.requestlog [None req-8a2636da-c1a2-465a-b3b9-311b09598f41 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.067311 Mar 05 02:45:50.463842 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: [pid: 109114|app: 0|req: 18/37] 10.222.0.26 () {60 vars in 1291 bytes} [Sat Mar 5 02:45:50 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 02:45:51.832420 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi [None req-c71713ca-dc10-41c7-b0e0-ec2c37ae3824 admin admin] Calling method '>' {{(pid=109113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:45:51.833867 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: INFO nova.api.openstack.requestlog [None req-c71713ca-dc10-41c7-b0e0-ec2c37ae3824 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002076 Mar 05 02:45:51.834440 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: [pid: 109113|app: 0|req: 20/38] 10.222.0.26 () {56 vars in 1074 bytes} [Sat Mar 5 02:45:51 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 02:45:52.042731 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi [None req-ef638b37-e8ff-41fd-aeb3-40881fab9089 admin admin] Calling method '>' {{(pid=109114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:45:52.048697 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: INFO nova.api.openstack.wsgi [None req-ef638b37-e8ff-41fd-aeb3-40881fab9089 admin admin] HTTP exception thrown: Flavor 42 could not be found. Mar 05 02:45:52.049333 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi [None req-ef638b37-e8ff-41fd-aeb3-40881fab9089 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=109114) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 02:45:52.050152 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: INFO nova.api.openstack.requestlog [None req-ef638b37-e8ff-41fd-aeb3-40881fab9089 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.057456 Mar 05 02:45:52.050654 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: [pid: 109114|app: 0|req: 19/39] 10.222.0.26 () {60 vars in 1190 bytes} [Sat Mar 5 02:45:51 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Mar 05 02:45:52.059856 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi [None req-d42074f0-ece4-4ad4-b934-d1d329fc3af2 admin admin] Calling method '>' {{(pid=109113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:45:52.081391 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: INFO nova.api.openstack.requestlog [None req-d42074f0-ece4-4ad4-b934-d1d329fc3af2 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025084 Mar 05 02:45:52.081916 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: [pid: 109113|app: 0|req: 21/40] 10.222.0.26 () {60 vars in 1210 bytes} [Sat Mar 5 02:45:52 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 02:45:52.091302 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi [None req-708d1423-3d60-4a14-80d9-787d9a8a3e43 admin admin] Calling method '>' {{(pid=109114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:45:52.112527 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: INFO nova.api.openstack.requestlog [None req-708d1423-3d60-4a14-80d9-787d9a8a3e43 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024688 Mar 05 02:45:52.113038 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: [pid: 109114|app: 0|req: 20/41] 10.222.0.26 () {60 vars in 1210 bytes} [Sat Mar 5 02:45:52 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 02:45:52.121975 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi [None req-56b66c90-04b7-418e-a2fb-35f61e7e0986 admin admin] Calling method '>' {{(pid=109113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:45:52.127848 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: INFO nova.api.openstack.wsgi [None req-56b66c90-04b7-418e-a2fb-35f61e7e0986 admin admin] HTTP exception thrown: Flavor 42 could not be found. Mar 05 02:45:52.128416 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi [None req-56b66c90-04b7-418e-a2fb-35f61e7e0986 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=109113) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 02:45:52.129233 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: INFO nova.api.openstack.requestlog [None req-56b66c90-04b7-418e-a2fb-35f61e7e0986 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.010808 Mar 05 02:45:52.129717 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: [pid: 109113|app: 0|req: 22/42] 10.222.0.26 () {60 vars in 1190 bytes} [Sat Mar 5 02:45:52 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Mar 05 02:45:53.394946 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi [None req-708d1423-3d60-4a14-80d9-787d9a8a3e43 admin admin] Calling method '>' {{(pid=109114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:45:53.395955 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: INFO nova.api.openstack.requestlog [None req-708d1423-3d60-4a14-80d9-787d9a8a3e43 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001416 Mar 05 02:45:53.396355 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: [pid: 109114|app: 0|req: 21/43] 10.222.0.26 () {56 vars in 1074 bytes} [Sat Mar 5 02:45:53 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 02:45:53.592522 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi [None req-34ef8f1a-7d2f-44a9-9117-11ae30d3e8d4 admin admin] Calling method '>' {{(pid=109113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:45:53.599127 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: INFO nova.api.openstack.wsgi [None req-34ef8f1a-7d2f-44a9-9117-11ae30d3e8d4 admin admin] HTTP exception thrown: Flavor 84 could not be found. Mar 05 02:45:53.599804 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi [None req-34ef8f1a-7d2f-44a9-9117-11ae30d3e8d4 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=109113) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 02:45:53.600670 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: INFO nova.api.openstack.requestlog [None req-34ef8f1a-7d2f-44a9-9117-11ae30d3e8d4 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.063438 Mar 05 02:45:53.601274 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: [pid: 109113|app: 0|req: 23/44] 10.222.0.26 () {60 vars in 1190 bytes} [Sat Mar 5 02:45:53 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Mar 05 02:45:53.611192 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi [None req-1405c607-cd97-4a49-8e1a-e004e4dba33c admin admin] Calling method '>' {{(pid=109114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:45:53.624326 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: INFO nova.api.openstack.requestlog [None req-1405c607-cd97-4a49-8e1a-e004e4dba33c admin admin] 10.222.0.26 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017183 Mar 05 02:45:53.624838 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: [pid: 109114|app: 0|req: 22/45] 10.222.0.26 () {60 vars in 1210 bytes} [Sat Mar 5 02:45:53 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 02:45:53.634157 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi [None req-6288529a-5900-48be-9a32-792265beee01 admin admin] Calling method '>' {{(pid=109113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:45:53.647787 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: INFO nova.api.openstack.requestlog [None req-6288529a-5900-48be-9a32-792265beee01 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017100 Mar 05 02:45:53.648303 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: [pid: 109113|app: 0|req: 24/46] 10.222.0.26 () {60 vars in 1210 bytes} [Sat Mar 5 02:45:53 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 05 02:45:53.657327 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi [None req-27b9eb37-3313-4a45-a8f6-0f1e3a00fde7 admin admin] Calling method '>' {{(pid=109114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:45:53.663170 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: INFO nova.api.openstack.wsgi [None req-27b9eb37-3313-4a45-a8f6-0f1e3a00fde7 admin admin] HTTP exception thrown: Flavor 84 could not be found. Mar 05 02:45:53.663726 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi [None req-27b9eb37-3313-4a45-a8f6-0f1e3a00fde7 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=109114) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 02:45:53.664573 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: INFO nova.api.openstack.requestlog [None req-27b9eb37-3313-4a45-a8f6-0f1e3a00fde7 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.010778 Mar 05 02:45:53.665140 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: [pid: 109114|app: 0|req: 23/47] 10.222.0.26 () {60 vars in 1190 bytes} [Sat Mar 5 02:45:53 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Mar 05 02:45:54.960881 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi [None req-6288529a-5900-48be-9a32-792265beee01 admin admin] Calling method '>' {{(pid=109113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:45:54.961877 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: INFO nova.api.openstack.requestlog [None req-6288529a-5900-48be-9a32-792265beee01 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001410 Mar 05 02:45:54.962303 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: [pid: 109113|app: 0|req: 25/48] 10.222.0.26 () {56 vars in 1074 bytes} [Sat Mar 5 02:45:54 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 02:45:55.151432 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi [None req-9bb05db5-c541-4cc0-aa09-5f78f44631a1 admin admin] Calling method '>' {{(pid=109114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:45:55.156975 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: INFO nova.api.openstack.wsgi [None req-9bb05db5-c541-4cc0-aa09-5f78f44631a1 admin admin] HTTP exception thrown: Flavor 451 could not be found. Mar 05 02:45:55.158241 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi [None req-9bb05db5-c541-4cc0-aa09-5f78f44631a1 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=109114) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 02:45:55.159025 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: INFO nova.api.openstack.requestlog [None req-9bb05db5-c541-4cc0-aa09-5f78f44631a1 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.058780 Mar 05 02:45:55.159523 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: [pid: 109114|app: 0|req: 24/49] 10.222.0.26 () {60 vars in 1193 bytes} [Sat Mar 5 02:45:55 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Mar 05 02:45:55.168632 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi [None req-4ca90e93-80dc-4602-9ab3-efd248c1a1fe admin admin] Calling method '>' {{(pid=109113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:45:55.181846 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: INFO nova.api.openstack.requestlog [None req-4ca90e93-80dc-4602-9ab3-efd248c1a1fe admin admin] 10.222.0.26 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.016725 Mar 05 02:45:55.182401 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: [pid: 109113|app: 0|req: 26/50] 10.222.0.26 () {60 vars in 1210 bytes} [Sat Mar 5 02:45:55 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 02:45:55.193766 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi [None req-e939d742-e918-483c-a284-fe7e71912b8b admin admin] Calling method '>' {{(pid=109114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:45:55.207554 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: INFO nova.api.openstack.requestlog [None req-e939d742-e918-483c-a284-fe7e71912b8b admin admin] 10.222.0.26 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019406 Mar 05 02:45:55.208014 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: [pid: 109114|app: 0|req: 25/51] 10.222.0.26 () {60 vars in 1210 bytes} [Sat Mar 5 02:45:55 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 02:45:55.217168 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi [None req-44cd0872-b228-4d9c-812a-84fba8e30b11 admin admin] Calling method '>' {{(pid=109113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:45:55.223239 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: INFO nova.api.openstack.wsgi [None req-44cd0872-b228-4d9c-812a-84fba8e30b11 admin admin] HTTP exception thrown: Flavor 451 could not be found. Mar 05 02:45:55.223798 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi [None req-44cd0872-b228-4d9c-812a-84fba8e30b11 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=109113) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 02:45:55.224571 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: INFO nova.api.openstack.requestlog [None req-44cd0872-b228-4d9c-812a-84fba8e30b11 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.011046 Mar 05 02:45:55.225053 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: [pid: 109113|app: 0|req: 27/52] 10.222.0.26 () {60 vars in 1193 bytes} [Sat Mar 5 02:45:55 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Mar 05 02:45:56.494964 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi [None req-e939d742-e918-483c-a284-fe7e71912b8b admin admin] Calling method '>' {{(pid=109114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:45:56.495949 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: INFO nova.api.openstack.requestlog [None req-e939d742-e918-483c-a284-fe7e71912b8b admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001406 Mar 05 02:45:56.496335 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: [pid: 109114|app: 0|req: 26/53] 10.222.0.26 () {56 vars in 1074 bytes} [Sat Mar 5 02:45:56 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 02:45:56.685491 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi [None req-fd53f2d1-3de5-4dae-9d05-a00dc334ae83 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=109113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 02:45:56.704133 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: INFO nova.api.openstack.requestlog [None req-fd53f2d1-3de5-4dae-9d05-a00dc334ae83 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.070315 Mar 05 02:45:56.704685 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: [pid: 109113|app: 0|req: 28/54] 10.222.0.26 () {64 vars in 1235 bytes} [Sat Mar 5 02:45:56 2022] POST /compute/v2.1/flavors => generated 404 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 05 02:45:57.983022 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi [None req-e939d742-e918-483c-a284-fe7e71912b8b admin admin] Calling method '>' {{(pid=109114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:45:57.984056 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: INFO nova.api.openstack.requestlog [None req-e939d742-e918-483c-a284-fe7e71912b8b admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001685 Mar 05 02:45:57.984485 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: [pid: 109114|app: 0|req: 27/55] 10.222.0.26 () {56 vars in 1074 bytes} [Sat Mar 5 02:45:57 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 02:45:58.172365 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi [None req-a55c5322-0afb-4b6a-b90e-baf4c68aa2d0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=109113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 02:45:58.190977 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: INFO nova.api.openstack.requestlog [None req-a55c5322-0afb-4b6a-b90e-baf4c68aa2d0 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.067392 Mar 05 02:45:58.191261 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: [pid: 109113|app: 0|req: 29/56] 10.222.0.26 () {64 vars in 1235 bytes} [Sat Mar 5 02:45:58 2022] POST /compute/v2.1/flavors => generated 405 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 05 02:45:59.485826 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi [None req-e939d742-e918-483c-a284-fe7e71912b8b admin admin] Calling method '>' {{(pid=109114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:45:59.487353 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: INFO nova.api.openstack.requestlog [None req-e939d742-e918-483c-a284-fe7e71912b8b admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001429 Mar 05 02:45:59.487737 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: [pid: 109114|app: 0|req: 28/57] 10.222.0.26 () {56 vars in 1074 bytes} [Sat Mar 5 02:45:59 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 02:45:59.677757 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi [None req-180c7d3f-bb69-433f-ba8b-15ca58deada3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=109113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 02:45:59.695252 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: INFO nova.api.openstack.requestlog [None req-180c7d3f-bb69-433f-ba8b-15ca58deada3 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.067885 Mar 05 02:45:59.695843 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: [pid: 109113|app: 0|req: 30/58] 10.222.0.26 () {64 vars in 1235 bytes} [Sat Mar 5 02:45:59 2022] POST /compute/v2.1/flavors => generated 407 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 05 02:46:00.960067 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi [None req-e939d742-e918-483c-a284-fe7e71912b8b admin admin] Calling method '>' {{(pid=109114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:46:00.961064 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: INFO nova.api.openstack.requestlog [None req-e939d742-e918-483c-a284-fe7e71912b8b admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001400 Mar 05 02:46:00.961462 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: [pid: 109114|app: 0|req: 29/59] 10.222.0.26 () {56 vars in 1074 bytes} [Sat Mar 5 02:46:00 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 02:46:01.152390 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi [None req-67398446-a70a-4db6-aeae-27ca41a24116 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=109113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 02:46:01.169571 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: INFO nova.api.openstack.requestlog [None req-67398446-a70a-4db6-aeae-27ca41a24116 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.067545 Mar 05 02:46:01.170048 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: [pid: 109113|app: 0|req: 31/60] 10.222.0.26 () {64 vars in 1235 bytes} [Sat Mar 5 02:46:01 2022] POST /compute/v2.1/flavors => generated 409 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 05 02:46:02.441808 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi [None req-e939d742-e918-483c-a284-fe7e71912b8b admin admin] Calling method '>' {{(pid=109114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:46:02.442834 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: INFO nova.api.openstack.requestlog [None req-e939d742-e918-483c-a284-fe7e71912b8b admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001432 Mar 05 02:46:02.443230 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: [pid: 109114|app: 0|req: 30/61] 10.222.0.26 () {56 vars in 1074 bytes} [Sat Mar 5 02:46:02 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 02:46:02.632253 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi [None req-1df7dcae-78c4-42c4-a05a-68317eb807e6 admin admin] Calling method '>' {{(pid=109113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:46:02.650871 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: INFO nova.api.openstack.requestlog [None req-1df7dcae-78c4-42c4-a05a-68317eb807e6 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.069156 Mar 05 02:46:02.651403 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: [pid: 109113|app: 0|req: 32/62] 10.222.0.26 () {60 vars in 1202 bytes} [Sat Mar 5 02:46:02 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 02:46:53.224552 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi [None req-e939d742-e918-483c-a284-fe7e71912b8b admin admin] Calling method '>' {{(pid=109114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:46:53.225555 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: INFO nova.api.openstack.requestlog [None req-e939d742-e918-483c-a284-fe7e71912b8b admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001396 Mar 05 02:46:53.225995 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: [pid: 109114|app: 0|req: 31/63] 10.222.0.26 () {54 vars in 930 bytes} [Sat Mar 5 02:46:53 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 02:46:53.283777 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi [None req-8e1507eb-d04c-42e3-86b6-236cbcb22436 admin admin] Calling method '>' {{(pid=109113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:46:53.302449 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: INFO nova.api.openstack.requestlog [None req-8e1507eb-d04c-42e3-86b6-236cbcb22436 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.070916 Mar 05 02:46:53.302967 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: [pid: 109113|app: 0|req: 33/64] 10.222.0.26 () {60 vars in 1291 bytes} [Sat Mar 5 02:46:53 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 05 02:46:53.324780 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi [None req-c421fea8-553a-4589-b297-06a4d82fde28 admin admin] Calling method '>' {{(pid=109114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:46:53.333297 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: INFO nova.api.openstack.requestlog [None req-c421fea8-553a-4589-b297-06a4d82fde28 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012088 Mar 05 02:46:53.333806 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: [pid: 109114|app: 0|req: 32/65] 10.222.0.26 () {60 vars in 1282 bytes} [Sat Mar 5 02:46:53 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 02:46:53.344577 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi [None req-e4904fb6-b15c-4a06-b72b-4953c2fe6133 admin admin] Calling method '>' {{(pid=109113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:46:53.352280 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: INFO nova.api.openstack.requestlog [None req-e4904fb6-b15c-4a06-b72b-4953c2fe6133 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011242 Mar 05 02:46:53.352788 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: [pid: 109113|app: 0|req: 34/66] 10.222.0.26 () {60 vars in 1285 bytes} [Sat Mar 5 02:46:53 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 02:46:53.364011 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi [None req-5a9f9383-194d-4372-b604-3022c2d3c9d9 admin admin] Calling method '>' {{(pid=109114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:46:53.371238 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: INFO nova.api.openstack.requestlog [None req-5a9f9383-194d-4372-b604-3022c2d3c9d9 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010724 Mar 05 02:46:53.371743 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: [pid: 109114|app: 0|req: 33/67] 10.222.0.26 () {60 vars in 1285 bytes} [Sat Mar 5 02:46:53 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 02:46:53.382812 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi [None req-87775723-f539-460f-b7a1-3bcbb523dd61 admin admin] Calling method '>' {{(pid=109113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:46:53.390100 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: INFO nova.api.openstack.requestlog [None req-87775723-f539-460f-b7a1-3bcbb523dd61 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010564 Mar 05 02:46:53.390606 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: [pid: 109113|app: 0|req: 35/68] 10.222.0.26 () {60 vars in 1282 bytes} [Sat Mar 5 02:46:53 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 02:48:31.304050 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi [None req-63bd3d6e-2615-4a78-aa0c-5035bb4ed476 tempest-verify_tempest_config-802006357 tempest-verify_tempest_config-802006357-project] Calling method '>' {{(pid=109114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:48:31.306060 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: INFO nova.api.openstack.requestlog [None req-63bd3d6e-2615-4a78-aa0c-5035bb4ed476 tempest-verify_tempest_config-802006357 tempest-verify_tempest_config-802006357-project] 10.222.0.26 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.104915 Mar 05 02:48:31.306582 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: [pid: 109114|app: 0|req: 34/69] 10.222.0.26 () {58 vars in 1133 bytes} [Sat Mar 5 02:48:31 2022] GET /compute/v2.1/extensions => generated 22700 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 05 02:50:03.060009 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi [None req-87775723-f539-460f-b7a1-3bcbb523dd61 admin admin] Calling method '>' {{(pid=109113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:50:03.061039 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: INFO nova.api.openstack.requestlog [None req-87775723-f539-460f-b7a1-3bcbb523dd61 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001448 Mar 05 02:50:03.061434 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: [pid: 109113|app: 0|req: 36/70] 10.222.0.26 () {56 vars in 1074 bytes} [Sat Mar 5 02:50:03 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 02:50:03.328930 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi [None req-043dcdf1-d1a0-463b-bbc9-b13c1f466826 admin admin] Calling method '>' {{(pid=109114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:50:03.330357 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 05 02:50:03.330357 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: warnings.warn(msg) Mar 05 02:50:03.331581 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG oslo_concurrency.lockutils [None req-043dcdf1-d1a0-463b-bbc9-b13c1f466826 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:50:03.332032 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG oslo_concurrency.lockutils [None req-043dcdf1-d1a0-463b-bbc9-b13c1f466826 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:50:03.332816 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG oslo_concurrency.lockutils [None req-043dcdf1-d1a0-463b-bbc9-b13c1f466826 admin admin] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:50:03.333269 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG oslo_concurrency.lockutils [None req-043dcdf1-d1a0-463b-bbc9-b13c1f466826 admin admin] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:50:03.367831 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: INFO nova.api.openstack.requestlog [None req-043dcdf1-d1a0-463b-bbc9-b13c1f466826 admin admin] 10.222.0.26 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.163705 Mar 05 02:50:03.368383 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: [pid: 109114|app: 0|req: 35/71] 10.222.0.26 () {60 vars in 1193 bytes} [Sat Mar 5 02:50:03 2022] GET /compute/v2.1/os-services => generated 791 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 05 02:50:04.665229 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi [None req-87775723-f539-460f-b7a1-3bcbb523dd61 admin admin] Calling method '>' {{(pid=109113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:50:04.666260 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: INFO nova.api.openstack.requestlog [None req-87775723-f539-460f-b7a1-3bcbb523dd61 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001407 Mar 05 02:50:04.666654 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: [pid: 109113|app: 0|req: 37/72] 10.222.0.26 () {56 vars in 1074 bytes} [Sat Mar 5 02:50:04 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 02:50:04.856716 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi [None req-3ced1300-ce43-4aa6-8322-123492490527 admin admin] Calling method '>' {{(pid=109114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:50:04.857886 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 05 02:50:04.857886 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: warnings.warn(msg) Mar 05 02:50:04.860182 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG oslo_concurrency.lockutils [None req-3ced1300-ce43-4aa6-8322-123492490527 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:50:04.860633 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG oslo_concurrency.lockutils [None req-3ced1300-ce43-4aa6-8322-123492490527 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:50:04.861541 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG oslo_concurrency.lockutils [None req-3ced1300-ce43-4aa6-8322-123492490527 admin admin] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:50:04.861993 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG oslo_concurrency.lockutils [None req-3ced1300-ce43-4aa6-8322-123492490527 admin admin] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:50:04.883283 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: INFO nova.api.openstack.requestlog [None req-3ced1300-ce43-4aa6-8322-123492490527 admin admin] 10.222.0.26 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.076320 Mar 05 02:50:04.883846 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: [pid: 109114|app: 0|req: 36/73] 10.222.0.26 () {60 vars in 1193 bytes} [Sat Mar 5 02:50:04 2022] GET /compute/v2.1/os-services => generated 791 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 05 02:50:16.592639 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi [None req-87775723-f539-460f-b7a1-3bcbb523dd61 admin admin] Calling method '>' {{(pid=109113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:50:16.593634 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: INFO nova.api.openstack.requestlog [None req-87775723-f539-460f-b7a1-3bcbb523dd61 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001407 Mar 05 02:50:16.594056 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: [pid: 109113|app: 0|req: 38/74] 10.222.0.26 () {56 vars in 1074 bytes} [Sat Mar 5 02:50:16 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 02:50:16.784494 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi [None req-1c99221e-77cf-4b66-a870-3d2820ca368c admin admin] Calling method '>' {{(pid=109114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:50:16.785629 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 05 02:50:16.785629 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: warnings.warn(msg) Mar 05 02:50:16.786844 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG oslo_concurrency.lockutils [None req-1c99221e-77cf-4b66-a870-3d2820ca368c admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:50:16.787285 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG oslo_concurrency.lockutils [None req-1c99221e-77cf-4b66-a870-3d2820ca368c admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:50:16.788060 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG oslo_concurrency.lockutils [None req-1c99221e-77cf-4b66-a870-3d2820ca368c admin admin] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:50:16.788486 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG oslo_concurrency.lockutils [None req-1c99221e-77cf-4b66-a870-3d2820ca368c admin admin] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:50:16.813081 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: INFO nova.api.openstack.requestlog [None req-1c99221e-77cf-4b66-a870-3d2820ca368c admin admin] 10.222.0.26 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.078933 Mar 05 02:50:16.814354 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: [pid: 109114|app: 0|req: 37/75] 10.222.0.26 () {60 vars in 1193 bytes} [Sat Mar 5 02:50:16 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 02:50:18.146408 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: DEBUG nova.api.openstack.wsgi [None req-87775723-f539-460f-b7a1-3bcbb523dd61 admin admin] Calling method '>' {{(pid=109113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:50:18.147427 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: INFO nova.api.openstack.requestlog [None req-87775723-f539-460f-b7a1-3bcbb523dd61 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001458 Mar 05 02:50:18.147816 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: [pid: 109113|app: 0|req: 39/76] 10.222.0.26 () {56 vars in 1074 bytes} [Sat Mar 5 02:50:18 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 02:50:18.337506 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG nova.api.openstack.wsgi [None req-2bad78a4-a7e9-4bff-abee-e40add2dd851 admin admin] Calling method '>' {{(pid=109114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:50:18.338704 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 05 02:50:18.338704 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: warnings.warn(msg) Mar 05 02:50:18.339881 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG oslo_concurrency.lockutils [None req-2bad78a4-a7e9-4bff-abee-e40add2dd851 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:50:18.340354 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG oslo_concurrency.lockutils [None req-2bad78a4-a7e9-4bff-abee-e40add2dd851 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:50:18.341170 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG oslo_concurrency.lockutils [None req-2bad78a4-a7e9-4bff-abee-e40add2dd851 admin admin] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:50:18.341604 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: DEBUG oslo_concurrency.lockutils [None req-2bad78a4-a7e9-4bff-abee-e40add2dd851 admin admin] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:50:18.363743 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: INFO nova.api.openstack.requestlog [None req-2bad78a4-a7e9-4bff-abee-e40add2dd851 admin admin] 10.222.0.26 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.076703 Mar 05 02:50:18.364222 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: [pid: 109114|app: 0|req: 38/77] 10.222.0.26 () {60 vars in 1193 bytes} [Sat Mar 5 02:50:18 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 02:51:15.557662 dv-cinder-827259-3-iscsi devstack@n-api.service[109112]: Sat Mar 5 02:51:15 2022 - graceful shutdown triggered... Mar 05 02:51:15.558246 dv-cinder-827259-3-iscsi devstack@n-api.service[109114]: Gracefully killing worker 2 (pid: 109114)... Mar 05 02:51:15.558617 dv-cinder-827259-3-iscsi devstack@n-api.service[109113]: Gracefully killing worker 1 (pid: 109113)... Mar 05 02:51:15.559925 dv-cinder-827259-3-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Mar 05 02:51:16.558787 dv-cinder-827259-3-iscsi devstack@n-api.service[109112]: worker 1 buried after 1 seconds Mar 05 02:51:16.559224 dv-cinder-827259-3-iscsi devstack@n-api.service[109112]: worker 2 buried after 1 seconds Mar 05 02:51:16.559224 dv-cinder-827259-3-iscsi devstack@n-api.service[109112]: goodbye to uWSGI. Mar 05 02:51:16.560315 dv-cinder-827259-3-iscsi systemd[1]: devstack@n-api.service: Succeeded. Mar 05 02:51:16.560885 dv-cinder-827259-3-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Mar 05 02:51:16.563939 dv-cinder-827259-3-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Mar 05 02:51:16.588694 dv-cinder-827259-3-iscsi devstack@n-api.service[123528]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Mar 05 02:51:16.603338 dv-cinder-827259-3-iscsi devstack@n-api.service[123528]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sat Mar 5 02:51:16 2022] *** Mar 05 02:51:16.603338 dv-cinder-827259-3-iscsi devstack@n-api.service[123528]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Mar 05 02:51:16.603338 dv-cinder-827259-3-iscsi devstack@n-api.service[123528]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Mar 05 02:51:16.603338 dv-cinder-827259-3-iscsi devstack@n-api.service[123528]: nodename: dv-cinder-827259-3-iscsi Mar 05 02:51:16.603338 dv-cinder-827259-3-iscsi devstack@n-api.service[123528]: machine: x86_64 Mar 05 02:51:16.603338 dv-cinder-827259-3-iscsi devstack@n-api.service[123528]: clock source: unix Mar 05 02:51:16.603338 dv-cinder-827259-3-iscsi devstack@n-api.service[123528]: pcre jit disabled Mar 05 02:51:16.603338 dv-cinder-827259-3-iscsi devstack@n-api.service[123528]: detected number of CPU cores: 4 Mar 05 02:51:16.603338 dv-cinder-827259-3-iscsi devstack@n-api.service[123528]: current working directory: / Mar 05 02:51:16.603338 dv-cinder-827259-3-iscsi devstack@n-api.service[123528]: detected binary path: /usr/bin/uwsgi-core Mar 05 02:51:16.604138 dv-cinder-827259-3-iscsi devstack@n-api.service[123528]: your processes number limit is 47680 Mar 05 02:51:16.604138 dv-cinder-827259-3-iscsi devstack@n-api.service[123528]: your memory page size is 4096 bytes Mar 05 02:51:16.604138 dv-cinder-827259-3-iscsi devstack@n-api.service[123528]: detected max file descriptor number: 2048 Mar 05 02:51:16.604138 dv-cinder-827259-3-iscsi devstack@n-api.service[123528]: lock engine: pthread robust mutexes Mar 05 02:51:16.604138 dv-cinder-827259-3-iscsi devstack@n-api.service[123528]: thunder lock: enabled Mar 05 02:51:16.604138 dv-cinder-827259-3-iscsi devstack@n-api.service[123528]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Mar 05 02:51:16.604138 dv-cinder-827259-3-iscsi devstack@n-api.service[123528]: Python version: 3.8.10 (default, Nov 26 2021, 20:14:08) [GCC 9.3.0] Mar 05 02:51:16.652569 dv-cinder-827259-3-iscsi devstack@n-api.service[123528]: Python main interpreter initialized at 0x56036236d9c0 Mar 05 02:51:16.652569 dv-cinder-827259-3-iscsi devstack@n-api.service[123528]: python threads support enabled Mar 05 02:51:16.652569 dv-cinder-827259-3-iscsi devstack@n-api.service[123528]: your server socket listen backlog is limited to 100 connections Mar 05 02:51:16.652569 dv-cinder-827259-3-iscsi devstack@n-api.service[123528]: your mercy for graceful operations on workers is 90 seconds Mar 05 02:51:16.652987 dv-cinder-827259-3-iscsi devstack@n-api.service[123528]: mapped 403077 bytes (393 KB) for 2 cores Mar 05 02:51:16.652987 dv-cinder-827259-3-iscsi devstack@n-api.service[123528]: *** Operational MODE: preforking *** Mar 05 02:51:16.653268 dv-cinder-827259-3-iscsi devstack@n-api.service[123528]: *** uWSGI is running in multiple interpreter mode *** Mar 05 02:51:16.653268 dv-cinder-827259-3-iscsi devstack@n-api.service[123528]: spawned uWSGI master process (pid: 123528) Mar 05 02:51:16.653475 dv-cinder-827259-3-iscsi systemd[1]: Started Devstack devstack@n-api.service. Mar 05 02:51:16.654269 dv-cinder-827259-3-iscsi devstack@n-api.service[123528]: spawned uWSGI worker 1 (pid: 123545, cores: 1) Mar 05 02:51:16.655883 dv-cinder-827259-3-iscsi devstack@n-api.service[123528]: spawned uWSGI worker 2 (pid: 123546, cores: 1) Mar 05 02:51:16.655883 dv-cinder-827259-3-iscsi devstack@n-api.service[123528]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Mar 05 02:51:18.593366 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Mar 05 02:51:18.593366 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: from cryptography.utils import int_from_bytes Mar 05 02:51:18.594021 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Mar 05 02:51:18.594021 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: from cryptography.utils import int_from_bytes Mar 05 02:51:18.594779 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Mar 05 02:51:18.594779 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: from cryptography.utils import int_from_bytes Mar 05 02:51:18.595284 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Mar 05 02:51:18.595284 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: from cryptography.utils import int_from_bytes Mar 05 02:51:21.043846 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Mar 05 02:51:21.044406 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Mar 05 02:51:21.044696 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Mar 05 02:51:21.044972 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Mar 05 02:51:21.045231 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Mar 05 02:51:21.045623 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:51:21.045981 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:51:21.046301 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:51:21.046626 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:51:21.046976 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:51:21.047277 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:51:21.047601 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:51:21.047927 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:51:21.048261 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:51:21.048526 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:51:21.049480 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:51:21.049795 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-827259-3-iscsi {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:51:21.050152 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:51:21.050472 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:51:21.050788 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:51:21.051112 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:51:21.051422 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:51:21.051750 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:51:21.052067 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:51:21.052678 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:51:21.054023 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:51:21.054023 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:51:21.054023 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:51:21.054023 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:51:21.054327 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:51:21.054764 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:51:21.054884 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:51:21.055250 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:51:21.055584 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:51:21.055894 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:51:21.056309 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-827259-3-iscsi {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:51:21.056628 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:51:21.056942 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:51:21.057261 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:51:21.057685 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:51:21.058025 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:51:21.058335 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:51:21.058662 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:51:21.058989 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:51:21.059306 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:51:21.059640 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:51:21.059965 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:51:21.060291 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:51:21.060617 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:51:21.060926 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:51:21.061249 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:51:21.061557 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:51:21.061889 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:51:21.062234 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:51:21.062547 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:51:21.062801 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:51:21.063113 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:51:21.063440 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:51:21.063767 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:51:21.064096 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:51:21.064355 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:51:21.064656 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:51:21.064986 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:51:21.065311 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:51:21.065624 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:51:21.065942 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:51:21.066275 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:51:21.066669 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:51:21.066885 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:51:21.067198 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:51:21.067508 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:51:21.067854 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:51:21.068136 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:51:21.068478 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:51:21.068887 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:51:21.069198 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:51:21.069523 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:51:21.069927 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.26 {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:51:21.070277 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.26 {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:51:21.070591 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:51:21.070940 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:51:21.071265 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:51:21.071580 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:51:21.071908 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:51:21.072233 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:51:21.072543 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:51:21.072855 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:51:21.073166 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:51:21.073489 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:51:21.073832 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:51:21.074167 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:51:21.074422 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:51:21.074728 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:51:21.075039 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:51:21.075363 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:51:21.075674 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:51:21.075983 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:51:21.076292 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:51:21.076595 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:51:21.076901 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:51:21.077211 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:51:21.077520 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:51:21.077828 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:51:21.078160 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:51:21.078467 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:51:21.078775 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:51:21.079081 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:51:21.079389 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:51:21.079709 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:51:21.080571 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:51:21.080930 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:51:21.081385 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:51:21.081698 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:51:21.082033 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:51:21.082361 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:51:21.082677 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:51:21.082986 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:51:21.083311 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:51:21.083620 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:51:21.083926 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:51:21.084248 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:51:21.084558 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:51:21.084866 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:51:21.085189 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:51:21.085493 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:51:21.085802 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:51:21.086148 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:51:21.086459 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:51:21.086767 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:51:21.087074 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:51:21.087380 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:51:21.087688 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:51:21.087994 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:51:21.088349 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:51:21.088671 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:51:21.089440 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:51:21.089440 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:51:21.089658 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:51:21.090004 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:51:21.090319 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:51:21.090628 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:51:21.090955 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:51:21.091299 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.091636 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.091986 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.092307 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.092651 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.092986 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.093497 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.094011 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.094325 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.094663 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.094983 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.095307 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.095673 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.097146 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.097477 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.097820 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.098172 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.098500 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.098828 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.099150 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.099475 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.099811 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.100144 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.100753 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.101227 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.101583 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.101908 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.102294 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.102630 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.102952 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.103272 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.103591 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.103927 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.104266 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.104583 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.104907 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.105464 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.105792 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.106137 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.106455 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.106771 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.107111 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.107428 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.107747 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.108062 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.108383 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.108699 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.109015 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.109330 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.109568 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Mar 05 02:51:21.110012 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.110117 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Mar 05 02:51:21.110289 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.110289 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.110447 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Mar 05 02:51:21.110558 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.110722 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Mar 05 02:51:21.110867 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.110969 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Mar 05 02:51:21.111196 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.111390 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:51:21.111714 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.111807 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:51:21.112032 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.112132 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:51:21.112354 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:51:21.112445 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.112675 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.112796 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:51:21.112993 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.113086 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:51:21.113311 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.113404 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:51:21.113628 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.113733 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:51:21.113946 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.114135 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:51:21.114230 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:51:21.114323 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.114549 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:51:21.114650 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.114882 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-827259-3-iscsi {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:51:21.114974 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.115211 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.115317 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:51:21.115521 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:51:21.115621 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.115830 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.115927 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:51:21.116156 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:51:21.116245 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.116465 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.116568 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:51:21.116777 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.116880 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:51:21.117091 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:51:21.117181 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.117406 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.117608 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:51:21.117716 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.117926 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:51:21.118089 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.118264 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:51:21.118370 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.118579 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:51:21.118670 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.118921 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:51:21.119022 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.119243 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:51:21.119336 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.119558 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:51:21.119657 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.119880 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:51:21.119971 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.120195 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:51:21.120296 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.120526 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:51:21.120627 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.120841 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:51:21.120933 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.121162 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.121326 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-827259-3-iscsi {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:51:21.121473 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.121579 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:51:21.121788 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.121995 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:51:21.122138 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.122255 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:51:21.122423 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.122620 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:51:21.122714 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.122939 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:51:21.123034 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.123254 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:51:21.123354 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.123582 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:51:21.123739 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.123911 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:51:21.124007 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.124222 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.124315 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:51:21.124533 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.124639 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:51:21.124860 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.124951 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:51:21.125174 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.125274 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:51:21.125485 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.125588 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:51:21.125796 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.125934 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:51:21.126134 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.126235 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:51:21.126449 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:51:21.126552 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.126777 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:51:21.126934 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.127091 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:51:21.127218 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.127406 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:51:21.127563 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.127663 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:51:21.127890 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.127983 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:51:21.128222 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.128325 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:51:21.128542 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.128635 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:51:21.128865 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.128957 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:51:21.129154 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:51:21.129262 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.129411 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:51:21.129520 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.129736 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:51:21.129837 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.130088 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:51:21.130204 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.130404 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:51:21.130504 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.130720 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:51:21.130821 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.131033 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:51:21.131134 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.131346 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:51:21.131497 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.131660 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:51:21.131752 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.131971 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:51:21.132077 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.132281 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:51:21.132381 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.132592 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.132682 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:51:21.132914 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:51:21.133014 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.133234 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:51:21.133400 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.133562 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:51:21.133661 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.133874 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:51:21.133997 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.134240 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.134332 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:51:21.134559 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.134704 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.26 {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:51:21.134881 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.134984 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.26 {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:51:21.135201 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.135301 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:51:21.135518 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.135611 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:51:21.135834 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.135927 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:51:21.136151 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.136245 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:51:21.136475 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.136575 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:51:21.136790 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.136891 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:51:21.137110 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:51:21.137213 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.137421 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.137527 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:51:21.137730 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:51:21.137820 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.138081 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:51:21.138180 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.138428 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:51:21.138530 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.138739 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.138832 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:51:21.138993 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:51:21.139092 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.139298 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:51:21.139403 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.139608 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:51:21.139710 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.139933 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:51:21.140024 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.140245 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:51:21.140338 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.140557 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:51:21.140656 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.140867 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:51:21.140967 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.141173 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:51:21.141265 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.141483 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:51:21.141585 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.141795 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:51:21.141891 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.142128 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:51:21.142221 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.142438 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:51:21.143041 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.143275 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:51:21.143366 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.143585 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:51:21.143755 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.143902 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:51:21.144078 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.144183 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:51:21.144400 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.144503 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:51:21.144822 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.144935 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:51:21.145039 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.145129 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:51:21.145353 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.145446 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:51:21.145667 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.145758 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:51:21.146008 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.146106 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:51:21.146338 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:51:21.146433 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.146652 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.146753 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:51:21.146962 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:51:21.147049 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.147274 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:51:21.147367 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.147590 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.147691 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:51:21.147898 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:51:21.147989 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.148207 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:51:21.148307 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.148527 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.148631 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:51:21.148838 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.148939 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:51:21.149144 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:51:21.149242 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.149449 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.149628 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:51:21.149798 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.149902 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:51:21.150145 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.150239 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:51:21.150457 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.150550 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:51:21.150779 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.150872 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:51:21.151105 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.151205 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:51:21.151414 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:51:21.151513 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.151726 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:51:21.151816 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.152037 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:51:21.152128 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.152347 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:51:21.152448 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.152658 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:51:21.152749 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.152967 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:51:21.153067 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.153273 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:51:21.153374 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.153584 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.153682 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:51:21.153897 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.154032 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:51:21.154239 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:51:21.154332 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.154552 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.154649 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:51:21.154862 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:51:21.154971 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.155179 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.155270 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 05 02:51:21.155491 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.155590 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.155804 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.155906 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.156114 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.156214 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.156444 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.156540 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.156736 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.156830 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.157150 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.157316 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.157479 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.157652 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.157799 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.157986 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.158173 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.159056 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.159162 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.159416 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.159558 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.159744 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.159886 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.160083 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.160199 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.160417 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.160513 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.160768 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.160867 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.161083 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.161183 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.161400 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.161501 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.161711 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.161803 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.162046 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.162155 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.162365 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.162459 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.162675 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.162776 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.162983 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.163076 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.163293 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.163393 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.163608 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.163714 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.163918 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.164018 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.164231 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.164356 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.164541 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.164678 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.164851 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.165009 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.165169 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.165337 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.165477 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.165657 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.165792 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.165994 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.166126 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.166316 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.166462 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.166649 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.166750 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.166987 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.167079 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.167303 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.167405 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.167626 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.167726 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.167943 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.168050 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.168260 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.168365 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.168576 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.168714 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.168893 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.168985 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.169209 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.169311 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.169550 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.169649 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.169855 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.170037 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.170206 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.170299 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.170516 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.170605 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.170827 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.170928 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.171137 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.171231 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.171450 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.171548 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.171761 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.171860 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.172070 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.172164 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.172381 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.172472 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.172693 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.172784 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.173007 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.173099 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.173314 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.173404 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.173620 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.173709 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.174047 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.174256 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.174402 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.174503 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.174670 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.174820 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.174984 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.175100 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.175292 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.175424 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.175599 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.175745 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.175912 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.176063 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.176224 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.176379 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.176529 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.176699 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.176843 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.177021 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.177149 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.177334 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.177471 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.177667 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.177769 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.178006 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.178102 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.178321 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.178426 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.178652 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.178754 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.178967 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.179066 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.179272 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.179415 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.179592 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.179682 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.179901 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.179999 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.180210 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.180312 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.180515 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.180607 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.180825 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.180916 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.181132 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.181241 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.181438 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.181531 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.181750 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.181849 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.182107 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.182202 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.182430 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.182522 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.182740 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.182832 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.183054 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.183147 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.183363 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.183454 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.183673 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.183764 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.183982 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.184074 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.184302 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.184399 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.184609 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.184707 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.184916 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.185016 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.185223 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.185361 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.185533 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.185640 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.185839 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.185930 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.186175 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.186279 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.186488 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.186589 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.186792 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.186890 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.187099 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.187190 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.187404 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.187505 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.187734 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.187826 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.188047 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.188146 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.188360 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.188460 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.188675 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.188775 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.189010 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.189108 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.189327 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.189451 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.189687 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.189778 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.190032 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.190195 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.190350 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.190444 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.190659 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.190759 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.190981 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.191074 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.191334 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.191426 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.191606 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.191698 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.191915 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.192016 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.192224 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.192316 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.192546 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.192644 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.192857 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.192958 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.193171 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.193271 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.193495 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.193587 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.193811 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.193916 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.194171 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.194278 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.194480 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.194615 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.194794 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.194896 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.195107 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.195206 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.195417 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.195508 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.195730 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.195832 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.196044 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.196137 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.196358 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.196492 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.196675 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.196768 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.196991 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.197084 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.197306 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.197398 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.197620 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.197759 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.197930 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.198047 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.198271 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.198372 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.198584 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.198684 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.198895 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.198994 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.199209 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.199299 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.199526 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.199617 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.199835 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.199934 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.200150 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.200306 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.200481 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.200569 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.200759 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.200851 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.201068 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.201173 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.201385 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.201502 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.201718 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.201816 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.202145 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.202264 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.202453 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.202557 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.202766 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.202857 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.203081 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.203246 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.203399 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.203489 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.203716 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.203806 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.204034 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.204134 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.204341 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.204440 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.204652 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.204754 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.204970 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.205612 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.205901 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.206024 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.206325 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.206437 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.206640 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.206804 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.206957 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.207270 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.207363 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.207587 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.207745 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.207899 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.208208 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.208297 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.208536 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.208694 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.208847 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.209140 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.209241 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.209581 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.209674 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.209899 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.210072 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.210237 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.210560 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.210663 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.210964 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.211064 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.211286 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.211576 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.211678 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.211899 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.211995 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.212217 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.212312 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.212543 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.212646 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.212860 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.212962 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.213174 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.213286 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.213484 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.213583 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.213798 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.213907 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.214144 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.214250 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.214470 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.214605 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.214779 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.214886 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.215104 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.215204 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.215428 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.215518 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.215746 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.215851 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.216068 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.216171 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.216387 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.216479 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.216703 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.216807 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.217033 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.217133 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.217360 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.217451 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.217674 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.217768 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.218013 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.218112 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.218332 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.218424 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.218651 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.218752 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.218960 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.219059 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.219269 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.219368 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.219590 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.219681 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.219896 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.219986 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.220211 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.220312 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.220521 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.220641 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.221389 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.221649 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.221751 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.222112 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.222309 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.222436 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.222651 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.222756 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.222970 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.223072 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.223295 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.223398 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.223620 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.223720 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.223943 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.224054 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.224279 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.224372 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.224610 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.224750 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.224950 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.225051 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.225264 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.225363 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.225574 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.225674 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.225884 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.226011 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.226222 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.226316 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.226540 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.226634 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.226851 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.226954 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.227166 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.227261 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.227477 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.227581 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.227793 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.227886 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.228102 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.228207 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.228411 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.228504 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.228720 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.228820 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.229028 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.229133 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.229348 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.229441 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.229659 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.229750 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.229991 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.230106 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.230572 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.230679 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.230902 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.231033 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.231217 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.231350 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.231525 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.231621 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.231834 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.231934 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.232143 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.232234 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.232451 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.232542 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.232760 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.232879 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.233065 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.233166 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.233394 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.233487 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.233705 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.233805 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.234063 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.234159 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.234377 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.234476 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.234686 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.234832 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.234996 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.235096 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.235309 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.235584 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.235686 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.235921 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.236020 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.236250 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.236890 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.237133 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.237238 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.237452 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.237544 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.237769 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.237870 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.238112 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.238208 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.238431 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.238534 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.238742 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.238834 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.239059 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.239152 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.239370 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.239463 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.239690 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.239780 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.240005 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.240104 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.240316 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.240408 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.240623 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.240715 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.240939 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.241040 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.241252 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.241353 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.241562 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.241663 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.241877 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.242006 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.242210 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.242305 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.242530 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.242746 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.242908 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.243080 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.243192 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.243398 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.243492 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.243717 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.243829 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.244040 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.244189 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.244357 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.244537 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.244675 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.244873 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.244991 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.245192 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.245296 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.245504 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.245605 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.245815 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.245908 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.246155 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.246265 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.246467 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.246561 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.246777 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.246878 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.247098 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.247211 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.247529 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.247635 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.247764 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.247870 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.248039 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.248151 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.248420 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.248525 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.248738 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.248831 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.249051 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.249157 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.249362 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.249455 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.249680 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.249772 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.250012 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.250132 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.250325 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.250472 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.250638 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.250736 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.250949 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.251040 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.251257 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.251350 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.251571 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.251663 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.252016 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.252618 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.252864 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.252993 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.253185 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.253320 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.253505 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.253665 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.253834 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.254081 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.254204 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.254421 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.254516 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.254812 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.254904 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.255137 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.255230 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.255458 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.255554 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.255801 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.255976 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.256138 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.256296 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.256471 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.256630 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.256807 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.256958 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.257133 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.257337 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.257524 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.257620 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.257786 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.257915 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.258142 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.258272 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.258468 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.258570 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.258790 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.258884 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.259132 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.259233 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.259461 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.259562 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.259774 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.259866 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.260101 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.260204 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.260419 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.260572 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.260730 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.260822 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.261054 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.261161 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.261367 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.261468 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.261698 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.261898 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.262058 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.262278 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.262370 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.262599 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.262691 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.262930 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.263032 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.263259 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.263352 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.263580 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.263673 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.263898 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.264004 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.264227 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.264322 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.264538 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.264646 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.264848 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.264956 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.265168 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.265270 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.265485 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.265586 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.265793 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.265892 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.266127 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.266235 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.266443 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.266544 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.266757 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.266869 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.267064 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.267158 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.267377 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.267567 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.267749 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.267851 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.268051 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.268144 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.268436 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.268542 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.268761 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.268854 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.269071 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.269171 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.269388 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.269491 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.269698 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.269800 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.270029 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.270139 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.270345 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.270454 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.270654 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.270757 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.270973 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.271066 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.271283 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.271395 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.271598 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.271700 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.271907 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.272049 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.272220 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.272325 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.272529 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.272631 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.272842 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.272936 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.273202 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.273306 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.273529 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.273632 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.273843 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.273936 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.274179 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.274276 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.274498 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.274593 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.274813 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.274914 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.275142 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.275236 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.275459 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.275598 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.275772 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.275866 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.276121 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.276215 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.276441 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.276599 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.276926 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.277029 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.277251 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.277353 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.277589 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.277690 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.277926 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.278085 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.278287 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.278390 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.278598 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.278690 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.278911 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.279015 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.279224 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.279324 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.279552 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.279654 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.279870 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.279982 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.280186 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.280280 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.280500 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.280593 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.280814 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.280919 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.281125 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.281226 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.281439 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.281539 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.281753 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.281848 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.282095 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.282227 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.282410 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.282693 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.282833 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.283021 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.283133 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.283433 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.283525 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.283806 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.283912 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.284174 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.284274 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.284502 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.284603 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.284827 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.284930 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.285151 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.285255 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.285473 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.285566 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.285791 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.285932 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.286134 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.286329 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.286451 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.286689 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.286791 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.287059 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.287155 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.287394 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.287497 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.287714 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.287811 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.288021 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.288115 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.288442 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.288544 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.288758 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.288861 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.289081 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.289175 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.289406 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.289541 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.289721 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.289908 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.290082 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.290316 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.290410 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.290685 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.290818 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.291025 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.291125 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.291340 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.291435 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.291675 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.291771 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.292019 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.292121 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.292342 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.292434 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.292661 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.292755 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.292968 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.293068 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.293278 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.293382 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.293595 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.293688 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.294006 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.294110 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.294257 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.294368 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.294572 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.294665 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.294880 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.294981 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.295186 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.295293 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.295497 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.295593 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.295803 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.295933 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.296110 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.296214 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.296416 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.296548 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.296722 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.296824 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.297034 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.297129 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.297341 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.297441 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.297646 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.297787 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.297978 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.298081 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.298273 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.298380 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.298579 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.298680 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.299425 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.299566 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.299743 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.299893 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.300139 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.300241 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.300452 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.300559 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.300760 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.300853 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.301069 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.301171 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.301377 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.301479 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.301716 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.301809 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.302079 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.302194 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.302401 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.302501 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.302728 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.302830 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.303042 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.303150 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.303366 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.303472 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.303682 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.303775 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.304010 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.304118 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.304337 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.304429 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.304651 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.304750 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.304964 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.305071 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.305295 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.305389 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.305605 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.305705 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.305920 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.306080 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.306269 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.306360 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.306581 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.306681 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.306896 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.306990 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.307210 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.307353 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.307533 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.307632 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.307859 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.308004 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.308167 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.308268 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.308496 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.308719 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.308813 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.309058 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.309150 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.309384 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.309487 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.309707 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.309801 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.310052 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.310169 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.310374 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.310467 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.310690 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.310792 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.311009 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.311100 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.311321 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.311468 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.311637 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.311731 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.311954 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.312046 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.312271 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.312372 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.312604 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.312697 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.312936 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.313037 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.313266 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.313369 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.313590 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.313682 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.313914 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.314076 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.314261 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.314374 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.315187 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.315295 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.315526 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.315633 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.315847 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.315990 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.316165 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.316265 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.316476 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.316569 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.316721 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=123546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Mar 05 02:51:21.316815 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.317110 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.317433 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.317756 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.318103 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.318428 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.318751 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.319071 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.319393 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.319717 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.320052 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.320397 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.320730 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.321053 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.321375 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.321702 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.322267 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.322594 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.322938 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.323274 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.323610 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.323942 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.324311 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.324656 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.324974 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.325292 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.325612 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.325934 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.326274 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.326608 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.326931 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.327249 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.327582 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.327902 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.328443 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.328807 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.329138 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.329477 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.329815 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.330175 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.330544 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.330830 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.331147 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.331463 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.331787 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.332114 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.332429 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.332745 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.333064 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.333383 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.333696 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.334043 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.335280 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.335280 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.335280 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.335657 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.335804 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.335997 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.336315 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.336629 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.336948 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.337263 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.337590 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.337905 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.338250 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.338566 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.338888 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.339203 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.339380 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_db.sqlalchemy.engines [None req-eac32ffe-1ba0-40aa-9269-46eacbb4d2c8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123546) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 05 02:51:21.339519 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.339883 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.340222 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.340538 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.340853 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.341180 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.341499 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.341833 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.342190 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.342511 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.342872 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.343199 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.343757 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.344099 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.344429 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.344781 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.345125 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.345443 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.345942 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.346674 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.347013 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.347339 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.347768 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.348094 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.348417 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.348738 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.349058 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.349379 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.349698 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.350041 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.350363 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.350683 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.351003 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.351327 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.351683 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.352015 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.352343 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.352676 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.353003 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.353325 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.353646 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.353984 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.354308 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.354634 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.354978 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.355559 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.355875 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.356314 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.356637 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.356969 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.357300 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.357622 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.357973 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.358329 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.358651 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.358980 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.359314 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.359645 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.359995 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.360336 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.360674 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.360992 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.361816 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.362187 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.362521 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.362848 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.363169 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.363486 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.363801 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.364119 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.364432 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.364747 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.365061 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.365374 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.365693 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.366034 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.366353 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.366666 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.366981 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.367294 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.367607 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.367926 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.368240 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.368554 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.368869 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.369182 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.369494 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.369839 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.370211 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.370540 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.370873 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.371196 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.371528 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.371846 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.372179 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.372518 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.372843 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.373163 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.373504 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.373825 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.374172 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.374493 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.374814 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.375134 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.375454 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.375791 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.376128 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.376446 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.376782 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.377785 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.378222 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.378559 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.379210 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.379210 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.379539 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.379863 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.380189 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.380513 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.380836 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.381163 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.381490 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.381831 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.382196 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.382544 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.382884 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.383243 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.383567 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.383923 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.384264 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.384592 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.384914 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.385233 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 05 02:51:21.385484 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=123545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Mar 05 02:51:21.404875 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.context [None req-eac32ffe-1ba0-40aa-9269-46eacbb4d2c8 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),9d368175-6627-4876-8662-d12827d1bbec(cell1) {{(pid=123546) load_cells /opt/stack/nova/nova/context.py:464}} Mar 05 02:51:21.407985 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_db.sqlalchemy.engines [None req-70b9d314-1a3f-490d-9951-e2ede4ffacfb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123545) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 05 02:51:21.409319 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-eac32ffe-1ba0-40aa-9269-46eacbb4d2c8 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:51:21.410980 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-eac32ffe-1ba0-40aa-9269-46eacbb4d2c8 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:51:21.411822 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-eac32ffe-1ba0-40aa-9269-46eacbb4d2c8 None None] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:51:21.413817 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-eac32ffe-1ba0-40aa-9269-46eacbb4d2c8 None None] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:51:21.424881 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_db.sqlalchemy.engines [None req-eac32ffe-1ba0-40aa-9269-46eacbb4d2c8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123546) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 05 02:51:21.426272 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_db.sqlalchemy.engines [None req-eac32ffe-1ba0-40aa-9269-46eacbb4d2c8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123546) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 05 02:51:21.474175 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.context [None req-70b9d314-1a3f-490d-9951-e2ede4ffacfb None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),9d368175-6627-4876-8662-d12827d1bbec(cell1) {{(pid=123545) load_cells /opt/stack/nova/nova/context.py:464}} Mar 05 02:51:21.478523 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-70b9d314-1a3f-490d-9951-e2ede4ffacfb None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:51:21.480129 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-70b9d314-1a3f-490d-9951-e2ede4ffacfb None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:51:21.481227 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-70b9d314-1a3f-490d-9951-e2ede4ffacfb None None] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:51:21.483237 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-70b9d314-1a3f-490d-9951-e2ede4ffacfb None None] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:51:21.494759 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_db.sqlalchemy.engines [None req-70b9d314-1a3f-490d-9951-e2ede4ffacfb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123545) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 05 02:51:21.496058 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_db.sqlalchemy.engines [None req-70b9d314-1a3f-490d-9951-e2ede4ffacfb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123545) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 05 02:51:21.589914 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_db.sqlalchemy.engines [None req-eac32ffe-1ba0-40aa-9269-46eacbb4d2c8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123546) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 05 02:51:21.657483 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_db.sqlalchemy.engines [None req-70b9d314-1a3f-490d-9951-e2ede4ffacfb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123545) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 05 02:51:22.028849 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: WARNING keystonemiddleware.auth_token [None req-eac32ffe-1ba0-40aa-9269-46eacbb4d2c8 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Mar 05 02:51:22.036456 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: WARNING keystonemiddleware.auth_token [None req-eac32ffe-1ba0-40aa-9269-46eacbb4d2c8 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Mar 05 02:51:22.097045 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: WARNING keystonemiddleware.auth_token [None req-70b9d314-1a3f-490d-9951-e2ede4ffacfb None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Mar 05 02:51:22.104247 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: WARNING keystonemiddleware.auth_token [None req-70b9d314-1a3f-490d-9951-e2ede4ffacfb None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Mar 05 02:51:22.278547 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: WARNING keystonemiddleware.auth_token [None req-eac32ffe-1ba0-40aa-9269-46eacbb4d2c8 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Mar 05 02:51:22.285521 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: WARNING keystonemiddleware.auth_token [None req-eac32ffe-1ba0-40aa-9269-46eacbb4d2c8 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Mar 05 02:51:22.291423 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x56036236d9c0 pid: 123546 (default app) Mar 05 02:51:22.337578 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: WARNING keystonemiddleware.auth_token [None req-70b9d314-1a3f-490d-9951-e2ede4ffacfb None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Mar 05 02:51:22.343118 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: WARNING keystonemiddleware.auth_token [None req-70b9d314-1a3f-490d-9951-e2ede4ffacfb None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Mar 05 02:51:22.348910 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x56036236d9c0 pid: 123545 (default app) Mar 05 02:52:02.507184 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-d1d81b7e-da8e-4d00-8617-a9c9886ae1f4 tempest-VolumesGetTestJSON-96429134 tempest-VolumesGetTestJSON-96429134-project] Action: 'create', calling method: .version_select at 0x7f3f63d08c10>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-708377830", "metadata": {"Type": "work"}}} {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 02:52:02.648061 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-89d31782-7eed-496e-a991-fd9e314ac040 tempest-VolumesTestJSON-1091868368 tempest-VolumesTestJSON-1091868368-project] Calling method '.version_select at 0x7f3f63cd2820>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:52:04.170845 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-d1d81b7e-da8e-4d00-8617-a9c9886ae1f4 tempest-VolumesGetTestJSON-96429134 tempest-VolumesGetTestJSON-96429134-project] 10.222.0.26 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 2.707329 Mar 05 02:52:04.172356 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 1/1] 10.222.0.26 () {60 vars in 1155 bytes} [Sat Mar 5 02:52:01 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 2711 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Mar 05 02:52:04.271851 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-89d31782-7eed-496e-a991-fd9e314ac040 tempest-VolumesTestJSON-1091868368 tempest-VolumesTestJSON-1091868368-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/f03c8f0c-919c-4061-8fbc-f117fc5b89b9" status: 200 len: 351 microversion: 2.1 time: 1.871028 Mar 05 02:52:04.272993 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 1/2] 10.222.0.26 () {58 vars in 1244 bytes} [Sat Mar 5 02:52:02 2022] GET /compute/v2.1/os-volumes/f03c8f0c-919c-4061-8fbc-f117fc5b89b9 => generated 351 bytes in 1874 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 02:52:04.279283 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-2d54393e-c660-449d-924f-73c90288375f tempest-VolumesGetTestJSON-96429134 tempest-VolumesGetTestJSON-96429134-project] Calling method '.version_select at 0x7f3f63ba0b80>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:52:04.343555 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-b45cf704-9980-4f3e-a925-e1792aeceef6 tempest-DeleteServersTestJSON-1135736220 tempest-DeleteServersTestJSON-1135736220-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-320411279", "imageRef": "adbc7df1-116e-4f9f-a28d-a6a3c084cceb", "flavorRef": "452", "networks": [{"uuid": "f72cd3de-54cc-4942-9bee-0f994654820b"}]}} {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 02:52:04.365368 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-2d54393e-c660-449d-924f-73c90288375f tempest-VolumesGetTestJSON-96429134 tempest-VolumesGetTestJSON-96429134-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/d87118f8-d8b9-4ffa-a4ba-b3f298303d83" status: 200 len: 352 microversion: 2.1 time: 0.090969 Mar 05 02:52:04.366160 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 2/3] 10.222.0.26 () {58 vars in 1244 bytes} [Sat Mar 5 02:52:04 2022] GET /compute/v2.1/os-volumes/d87118f8-d8b9-4ffa-a4ba-b3f298303d83 => generated 352 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 02:52:04.471302 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.network.neutron [None req-b45cf704-9980-4f3e-a925-e1792aeceef6 tempest-DeleteServersTestJSON-1135736220 tempest-DeleteServersTestJSON-1135736220-project] validate_networks() for [('f72cd3de-54cc-4942-9bee-0f994654820b', None, None, None, None, None)] {{(pid=123546) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 05 02:52:05.382006 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-da424c2e-06c5-47d1-951a-ffc0f3409c3c tempest-VolumesGetTestJSON-96429134 tempest-VolumesGetTestJSON-96429134-project] Calling method '.version_select at 0x7f3f63b60310>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:52:05.461074 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-da424c2e-06c5-47d1-951a-ffc0f3409c3c tempest-VolumesGetTestJSON-96429134 tempest-VolumesGetTestJSON-96429134-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/d87118f8-d8b9-4ffa-a4ba-b3f298303d83" status: 200 len: 353 microversion: 2.1 time: 0.086791 Mar 05 02:52:05.461636 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 3/4] 10.222.0.26 () {58 vars in 1244 bytes} [Sat Mar 5 02:52:05 2022] GET /compute/v2.1/os-volumes/d87118f8-d8b9-4ffa-a4ba-b3f298303d83 => generated 353 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 02:52:05.474247 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-fa0d7d11-5cb3-4c82-8aef-f2b4b887030c tempest-VolumesGetTestJSON-96429134 tempest-VolumesGetTestJSON-96429134-project] Calling method '.version_select at 0x7f3f63b609d0>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:52:05.562327 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-fa0d7d11-5cb3-4c82-8aef-f2b4b887030c tempest-VolumesGetTestJSON-96429134 tempest-VolumesGetTestJSON-96429134-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/d87118f8-d8b9-4ffa-a4ba-b3f298303d83" status: 200 len: 353 microversion: 2.1 time: 0.093573 Mar 05 02:52:05.562884 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 4/5] 10.222.0.26 () {58 vars in 1244 bytes} [Sat Mar 5 02:52:05 2022] GET /compute/v2.1/os-volumes/d87118f8-d8b9-4ffa-a4ba-b3f298303d83 => generated 353 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 02:52:05.578962 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-bab074cb-eac7-40b6-a95b-139fc57de664 tempest-VolumesGetTestJSON-96429134 tempest-VolumesGetTestJSON-96429134-project] Calling method '.version_select at 0x7f3f63ba0dc0>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:52:05.698874 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-bab074cb-eac7-40b6-a95b-139fc57de664 tempest-VolumesGetTestJSON-96429134 tempest-VolumesGetTestJSON-96429134-project] 10.222.0.26 "DELETE /compute/v2.1/os-volumes/d87118f8-d8b9-4ffa-a4ba-b3f298303d83" status: 202 len: 0 microversion: 2.1 time: 0.123665 Mar 05 02:52:05.700386 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 5/6] 10.222.0.26 () {58 vars in 1247 bytes} [Sat Mar 5 02:52:05 2022] DELETE /compute/v2.1/os-volumes/d87118f8-d8b9-4ffa-a4ba-b3f298303d83 => generated 0 bytes in 126 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Mar 05 02:52:05.709457 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-21ca3c5e-8cd1-4400-a6fb-cc5d69058b54 tempest-VolumesGetTestJSON-96429134 tempest-VolumesGetTestJSON-96429134-project] Calling method '.version_select at 0x7f3f63b60a60>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:52:05.777665 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-21ca3c5e-8cd1-4400-a6fb-cc5d69058b54 tempest-VolumesGetTestJSON-96429134 tempest-VolumesGetTestJSON-96429134-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/d87118f8-d8b9-4ffa-a4ba-b3f298303d83" status: 200 len: 352 microversion: 2.1 time: 0.072842 Mar 05 02:52:05.778311 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 6/7] 10.222.0.26 () {58 vars in 1244 bytes} [Sat Mar 5 02:52:05 2022] GET /compute/v2.1/os-volumes/d87118f8-d8b9-4ffa-a4ba-b3f298303d83 => generated 352 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 02:52:05.786902 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-efe60656-c132-4294-84c1-bb492821e879 tempest-VolumesTestJSON-1091868368 tempest-VolumesTestJSON-1091868368-project] Calling method '.version_select at 0x7f3f63b60310>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:52:05.853194 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-efe60656-c132-4294-84c1-bb492821e879 tempest-VolumesTestJSON-1091868368 tempest-VolumesTestJSON-1091868368-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/9604c41f-43b1-4620-9083-d4d478078978" status: 200 len: 351 microversion: 2.1 time: 0.072528 Mar 05 02:52:05.854263 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 7/8] 10.222.0.26 () {58 vars in 1244 bytes} [Sat Mar 5 02:52:05 2022] GET /compute/v2.1/os-volumes/9604c41f-43b1-4620-9083-d4d478078978 => generated 351 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 02:52:06.310471 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.virt.hardware [None req-b45cf704-9980-4f3e-a925-e1792aeceef6 tempest-DeleteServersTestJSON-1135736220 tempest-DeleteServersTestJSON-1135736220-project] Flavor limits 0:0:0 {{(pid=123546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 05 02:52:06.311915 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.virt.hardware [None req-b45cf704-9980-4f3e-a925-e1792aeceef6 tempest-DeleteServersTestJSON-1135736220 tempest-DeleteServersTestJSON-1135736220-project] Image limits 0:0:0 {{(pid=123546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 05 02:52:06.312619 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.virt.hardware [None req-b45cf704-9980-4f3e-a925-e1792aeceef6 tempest-DeleteServersTestJSON-1135736220 tempest-DeleteServersTestJSON-1135736220-project] Flavor pref 0:0:0 {{(pid=123546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 05 02:52:06.313446 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.virt.hardware [None req-b45cf704-9980-4f3e-a925-e1792aeceef6 tempest-DeleteServersTestJSON-1135736220 tempest-DeleteServersTestJSON-1135736220-project] Image pref 0:0:0 {{(pid=123546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 05 02:52:06.314462 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.virt.hardware [None req-b45cf704-9980-4f3e-a925-e1792aeceef6 tempest-DeleteServersTestJSON-1135736220 tempest-DeleteServersTestJSON-1135736220-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 05 02:52:06.340400 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-b45cf704-9980-4f3e-a925-e1792aeceef6 tempest-DeleteServersTestJSON-1135736220 tempest-DeleteServersTestJSON-1135736220-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:52:06.344195 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-b45cf704-9980-4f3e-a925-e1792aeceef6 tempest-DeleteServersTestJSON-1135736220 tempest-DeleteServersTestJSON-1135736220-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:52:06.345802 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-b45cf704-9980-4f3e-a925-e1792aeceef6 tempest-DeleteServersTestJSON-1135736220 tempest-DeleteServersTestJSON-1135736220-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:52:06.346497 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-b45cf704-9980-4f3e-a925-e1792aeceef6 tempest-DeleteServersTestJSON-1135736220 tempest-DeleteServersTestJSON-1135736220-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:52:06.414271 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.quota [None req-b45cf704-9980-4f3e-a925-e1792aeceef6 tempest-DeleteServersTestJSON-1135736220 tempest-DeleteServersTestJSON-1135736220-project] Getting quotas for project 9b241a841129430e93d2a9d0da408b98. Resources: {'ram', 'cores', 'instances'} {{(pid=123546) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 02:52:06.431608 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.quota [None req-b45cf704-9980-4f3e-a925-e1792aeceef6 tempest-DeleteServersTestJSON-1135736220 tempest-DeleteServersTestJSON-1135736220-project] Getting quotas for user 22f302bdee4e47e79b975e5c0b88ff29 and project 9b241a841129430e93d2a9d0da408b98. Resources: {'ram', 'cores', 'instances'} {{(pid=123546) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 02:52:06.505102 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-b45cf704-9980-4f3e-a925-e1792aeceef6 tempest-DeleteServersTestJSON-1135736220 tempest-DeleteServersTestJSON-1135736220-project] Going to run 1 instances... {{(pid=123546) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 05 02:52:06.505102 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-b45cf704-9980-4f3e-a925-e1792aeceef6 tempest-DeleteServersTestJSON-1135736220 tempest-DeleteServersTestJSON-1135736220-project] [instance: e848196a-c1b4-4e17-a748-aa877bce4650] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='adbc7df1-116e-4f9f-a28d-a6a3c084cceb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123546) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 05 02:52:06.656153 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-b45cf704-9980-4f3e-a925-e1792aeceef6 tempest-DeleteServersTestJSON-1135736220 tempest-DeleteServersTestJSON-1135736220-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.480624 Mar 05 02:52:06.658992 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 2/9] 10.222.0.26 () {60 vars in 1146 bytes} [Sat Mar 5 02:52:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 2486 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 05 02:52:06.669698 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-00ec1f8a-e746-4c77-b13b-699ff8b54eeb tempest-DeleteServersTestJSON-1135736220 tempest-DeleteServersTestJSON-1135736220-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:52:06.670558 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-00ec1f8a-e746-4c77-b13b-699ff8b54eeb tempest-DeleteServersTestJSON-1135736220 tempest-DeleteServersTestJSON-1135736220-project] [instance: e848196a-c1b4-4e17-a748-aa877bce4650] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:52:06.796221 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-04395ea0-2d54-4080-845b-92c9c2d77bd2 tempest-VolumesGetTestJSON-96429134 tempest-VolumesGetTestJSON-96429134-project] Calling method '.version_select at 0x7f3f6327c5e0>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:52:06.885901 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.wsgi [None req-04395ea0-2d54-4080-845b-92c9c2d77bd2 tempest-VolumesGetTestJSON-96429134 tempest-VolumesGetTestJSON-96429134-project] HTTP exception thrown: Volume d87118f8-d8b9-4ffa-a4ba-b3f298303d83 could not be found. Mar 05 02:52:06.886575 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-04395ea0-2d54-4080-845b-92c9c2d77bd2 tempest-VolumesGetTestJSON-96429134 tempest-VolumesGetTestJSON-96429134-project] Returning 404 to user: Volume d87118f8-d8b9-4ffa-a4ba-b3f298303d83 could not be found. {{(pid=123546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 02:52:06.887591 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-04395ea0-2d54-4080-845b-92c9c2d77bd2 tempest-VolumesGetTestJSON-96429134 tempest-VolumesGetTestJSON-96429134-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/d87118f8-d8b9-4ffa-a4ba-b3f298303d83" status: 404 len: 109 microversion: 2.1 time: 0.098002 Mar 05 02:52:06.888137 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 3/10] 10.222.0.26 () {58 vars in 1244 bytes} [Sat Mar 5 02:52:06 2022] GET /compute/v2.1/os-volumes/d87118f8-d8b9-4ffa-a4ba-b3f298303d83 => generated 109 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 05 02:52:07.010499 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-00ec1f8a-e746-4c77-b13b-699ff8b54eeb tempest-DeleteServersTestJSON-1135736220 tempest-DeleteServersTestJSON-1135736220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22f302bdee4e47e79b975e5c0b88ff29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b241a841129430e93d2a9d0da408b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:52:07.056176 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-00ec1f8a-e746-4c77-b13b-699ff8b54eeb tempest-DeleteServersTestJSON-1135736220 tempest-DeleteServersTestJSON-1135736220-project] 10.222.0.26 "GET /compute/v2.1/servers/e848196a-c1b4-4e17-a748-aa877bce4650" status: 200 len: 1214 microversion: 2.1 time: 0.384157 Mar 05 02:52:07.059171 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 8/11] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:52:06 2022] GET /compute/v2.1/servers/e848196a-c1b4-4e17-a748-aa877bce4650 => generated 1214 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 02:52:07.390383 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-81f4ec5f-327a-4c4e-9142-832336a55c25 tempest-VolumesTestJSON-1091868368 tempest-VolumesTestJSON-1091868368-project] Calling method '.version_select at 0x7f3f6327c430>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:52:07.521503 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-81f4ec5f-327a-4c4e-9142-832336a55c25 tempest-VolumesTestJSON-1091868368 tempest-VolumesTestJSON-1091868368-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/5e089589-7a96-4643-9d2e-0e5d936fa08e" status: 200 len: 351 microversion: 2.1 time: 0.135092 Mar 05 02:52:07.522593 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 4/12] 10.222.0.26 () {58 vars in 1244 bytes} [Sat Mar 5 02:52:07 2022] GET /compute/v2.1/os-volumes/5e089589-7a96-4643-9d2e-0e5d936fa08e => generated 351 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 02:52:07.536635 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-859e2394-0bcc-4892-a465-afc790305037 tempest-VolumesTestJSON-1091868368 tempest-VolumesTestJSON-1091868368-project] Calling method '.version_select at 0x7f3f63b609d0>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:52:07.779192 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-859e2394-0bcc-4892-a465-afc790305037 tempest-VolumesTestJSON-1091868368 tempest-VolumesTestJSON-1091868368-project] 10.222.0.26 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.248820 Mar 05 02:52:07.779927 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 9/13] 10.222.0.26 () {58 vars in 1133 bytes} [Sat Mar 5 02:52:07 2022] GET /compute/v2.1/os-volumes => generated 1036 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 02:52:07.792849 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-ea70bebc-63fe-4f32-a055-cb35d3281d21 tempest-VolumesTestJSON-1091868368 tempest-VolumesTestJSON-1091868368-project] Calling method '.version_select at 0x7f3f62a17040>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:52:08.015969 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-ea70bebc-63fe-4f32-a055-cb35d3281d21 tempest-VolumesTestJSON-1091868368 tempest-VolumesTestJSON-1091868368-project] 10.222.0.26 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.226698 Mar 05 02:52:08.019446 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 5/14] 10.222.0.26 () {58 vars in 1148 bytes} [Sat Mar 5 02:52:07 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 02:52:08.033563 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-f576f8cc-5350-45f5-9462-49f1e029b022 tempest-VolumesTestJSON-1091868368 tempest-VolumesTestJSON-1091868368-project] Calling method '.version_select at 0x7f3f63b21c10>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:52:08.077684 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-f0120d5c-5660-43ee-b239-ae244d4c3453 tempest-DeleteServersTestJSON-1135736220 tempest-DeleteServersTestJSON-1135736220-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:52:08.079008 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-f0120d5c-5660-43ee-b239-ae244d4c3453 tempest-DeleteServersTestJSON-1135736220 tempest-DeleteServersTestJSON-1135736220-project] [instance: e848196a-c1b4-4e17-a748-aa877bce4650] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:52:08.233807 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-f576f8cc-5350-45f5-9462-49f1e029b022 tempest-VolumesTestJSON-1091868368 tempest-VolumesTestJSON-1091868368-project] 10.222.0.26 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.206515 Mar 05 02:52:08.234536 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 10/15] 10.222.0.26 () {58 vars in 1133 bytes} [Sat Mar 5 02:52:08 2022] GET /compute/v2.1/os-volumes => generated 1036 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 02:52:08.247935 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-c0f51ab6-410c-4f84-9317-cb17897eee6d tempest-VolumesTestJSON-1091868368 tempest-VolumesTestJSON-1091868368-project] Calling method '.version_select at 0x7f3f63b21b80>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:52:08.318940 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-f0120d5c-5660-43ee-b239-ae244d4c3453 tempest-DeleteServersTestJSON-1135736220 tempest-DeleteServersTestJSON-1135736220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22f302bdee4e47e79b975e5c0b88ff29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b241a841129430e93d2a9d0da408b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:52:08.378368 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-f0120d5c-5660-43ee-b239-ae244d4c3453 tempest-DeleteServersTestJSON-1135736220 tempest-DeleteServersTestJSON-1135736220-project] 10.222.0.26 "GET /compute/v2.1/servers/e848196a-c1b4-4e17-a748-aa877bce4650" status: 200 len: 1214 microversion: 2.1 time: 0.286044 Mar 05 02:52:08.379265 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 6/16] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:52:08 2022] GET /compute/v2.1/servers/e848196a-c1b4-4e17-a748-aa877bce4650 => generated 1214 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 02:52:08.455318 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-c0f51ab6-410c-4f84-9317-cb17897eee6d tempest-VolumesTestJSON-1091868368 tempest-VolumesTestJSON-1091868368-project] 10.222.0.26 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.213069 Mar 05 02:52:08.456888 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 11/17] 10.222.0.26 () {58 vars in 1166 bytes} [Sat Mar 5 02:52:08 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 05 02:52:08.479371 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-e0ae6450-05a4-497d-b17e-b00d60a3b496 tempest-VolumesTestJSON-1091868368 tempest-VolumesTestJSON-1091868368-project] Calling method '.version_select at 0x7f3f6327c940>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:52:08.642400 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-e0ae6450-05a4-497d-b17e-b00d60a3b496 tempest-VolumesTestJSON-1091868368 tempest-VolumesTestJSON-1091868368-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.168232 Mar 05 02:52:08.643355 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 7/18] 10.222.0.26 () {58 vars in 1169 bytes} [Sat Mar 5 02:52:08 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 02:52:08.655383 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-05dbd011-c7e7-4b37-8153-63768a375732 tempest-VolumesTestJSON-1091868368 tempest-VolumesTestJSON-1091868368-project] Calling method '.version_select at 0x7f3f643c3820>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:52:08.822152 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-05dbd011-c7e7-4b37-8153-63768a375732 tempest-VolumesTestJSON-1091868368 tempest-VolumesTestJSON-1091868368-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.170260 Mar 05 02:52:08.826510 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 12/19] 10.222.0.26 () {58 vars in 1154 bytes} [Sat Mar 5 02:52:08 2022] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 02:52:08.845512 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-1283920a-4f88-4d39-ab7f-8ddbbdfad953 tempest-VolumesTestJSON-1091868368 tempest-VolumesTestJSON-1091868368-project] Calling method '.version_select at 0x7f3f6327c700>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:52:09.143368 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-1283920a-4f88-4d39-ab7f-8ddbbdfad953 tempest-VolumesTestJSON-1091868368 tempest-VolumesTestJSON-1091868368-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.306813 Mar 05 02:52:09.143935 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 8/20] 10.222.0.26 () {58 vars in 1187 bytes} [Sat Mar 5 02:52:08 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 02:52:09.156578 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-d55fe8f2-9276-4b02-b14d-e1098fa3f097 tempest-VolumesTestJSON-1091868368 tempest-VolumesTestJSON-1091868368-project] Calling method '.version_select at 0x7f3f63b2e8b0>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:52:09.342693 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-d55fe8f2-9276-4b02-b14d-e1098fa3f097 tempest-VolumesTestJSON-1091868368 tempest-VolumesTestJSON-1091868368-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.190262 Mar 05 02:52:09.344485 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 13/21] 10.222.0.26 () {58 vars in 1154 bytes} [Sat Mar 5 02:52:09 2022] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 02:52:09.397744 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-4362e914-5de5-400c-9b42-2274edb04d43 tempest-DeleteServersTestJSON-1135736220 tempest-DeleteServersTestJSON-1135736220-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:52:09.398417 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-4362e914-5de5-400c-9b42-2274edb04d43 tempest-DeleteServersTestJSON-1135736220 tempest-DeleteServersTestJSON-1135736220-project] [instance: e848196a-c1b4-4e17-a748-aa877bce4650] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:52:09.420143 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-4362e914-5de5-400c-9b42-2274edb04d43 tempest-DeleteServersTestJSON-1135736220 tempest-DeleteServersTestJSON-1135736220-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:52:09.420669 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-4362e914-5de5-400c-9b42-2274edb04d43 tempest-DeleteServersTestJSON-1135736220 tempest-DeleteServersTestJSON-1135736220-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:52:09.421455 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-4362e914-5de5-400c-9b42-2274edb04d43 tempest-DeleteServersTestJSON-1135736220 tempest-DeleteServersTestJSON-1135736220-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:52:09.432301 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-4362e914-5de5-400c-9b42-2274edb04d43 tempest-DeleteServersTestJSON-1135736220 tempest-DeleteServersTestJSON-1135736220-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:52:10.201503 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-4362e914-5de5-400c-9b42-2274edb04d43 tempest-DeleteServersTestJSON-1135736220 tempest-DeleteServersTestJSON-1135736220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22f302bdee4e47e79b975e5c0b88ff29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b241a841129430e93d2a9d0da408b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:52:10.217292 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-4362e914-5de5-400c-9b42-2274edb04d43 tempest-DeleteServersTestJSON-1135736220 tempest-DeleteServersTestJSON-1135736220-project] 10.222.0.26 "GET /compute/v2.1/servers/e848196a-c1b4-4e17-a748-aa877bce4650" status: 200 len: 1210 microversion: 2.1 time: 0.824275 Mar 05 02:52:10.234614 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 9/22] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:52:09 2022] GET /compute/v2.1/servers/e848196a-c1b4-4e17-a748-aa877bce4650 => generated 1210 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 02:52:11.258451 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-7c96561f-436e-42b9-a8fa-f603cbd95b53 tempest-DeleteServersTestJSON-1135736220 tempest-DeleteServersTestJSON-1135736220-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:52:11.259209 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-7c96561f-436e-42b9-a8fa-f603cbd95b53 tempest-DeleteServersTestJSON-1135736220 tempest-DeleteServersTestJSON-1135736220-project] [instance: e848196a-c1b4-4e17-a748-aa877bce4650] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:52:11.271571 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-7c96561f-436e-42b9-a8fa-f603cbd95b53 tempest-DeleteServersTestJSON-1135736220 tempest-DeleteServersTestJSON-1135736220-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:52:11.276756 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-7c96561f-436e-42b9-a8fa-f603cbd95b53 tempest-DeleteServersTestJSON-1135736220 tempest-DeleteServersTestJSON-1135736220-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:52:11.277822 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-7c96561f-436e-42b9-a8fa-f603cbd95b53 tempest-DeleteServersTestJSON-1135736220 tempest-DeleteServersTestJSON-1135736220-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:52:11.279207 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-7c96561f-436e-42b9-a8fa-f603cbd95b53 tempest-DeleteServersTestJSON-1135736220 tempest-DeleteServersTestJSON-1135736220-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:52:12.138756 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-7c96561f-436e-42b9-a8fa-f603cbd95b53 tempest-DeleteServersTestJSON-1135736220 tempest-DeleteServersTestJSON-1135736220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22f302bdee4e47e79b975e5c0b88ff29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b241a841129430e93d2a9d0da408b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:52:12.182771 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-7c96561f-436e-42b9-a8fa-f603cbd95b53 tempest-DeleteServersTestJSON-1135736220 tempest-DeleteServersTestJSON-1135736220-project] 10.222.0.26 "GET /compute/v2.1/servers/e848196a-c1b4-4e17-a748-aa877bce4650" status: 200 len: 1272 microversion: 2.1 time: 0.931319 Mar 05 02:52:12.189520 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 14/23] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:52:11 2022] GET /compute/v2.1/servers/e848196a-c1b4-4e17-a748-aa877bce4650 => generated 1272 bytes in 942 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 02:52:13.206260 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-5ef180a2-0513-41b7-be42-2610a79242b3 tempest-DeleteServersTestJSON-1135736220 tempest-DeleteServersTestJSON-1135736220-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:52:13.206903 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-5ef180a2-0513-41b7-be42-2610a79242b3 tempest-DeleteServersTestJSON-1135736220 tempest-DeleteServersTestJSON-1135736220-project] [instance: e848196a-c1b4-4e17-a748-aa877bce4650] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:52:13.228645 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-5ef180a2-0513-41b7-be42-2610a79242b3 tempest-DeleteServersTestJSON-1135736220 tempest-DeleteServersTestJSON-1135736220-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:52:13.229820 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-5ef180a2-0513-41b7-be42-2610a79242b3 tempest-DeleteServersTestJSON-1135736220 tempest-DeleteServersTestJSON-1135736220-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:52:13.231446 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-5ef180a2-0513-41b7-be42-2610a79242b3 tempest-DeleteServersTestJSON-1135736220 tempest-DeleteServersTestJSON-1135736220-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:52:13.232903 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-5ef180a2-0513-41b7-be42-2610a79242b3 tempest-DeleteServersTestJSON-1135736220 tempest-DeleteServersTestJSON-1135736220-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:52:14.023031 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-5ef180a2-0513-41b7-be42-2610a79242b3 tempest-DeleteServersTestJSON-1135736220 tempest-DeleteServersTestJSON-1135736220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22f302bdee4e47e79b975e5c0b88ff29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b241a841129430e93d2a9d0da408b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:52:14.032629 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-5ef180a2-0513-41b7-be42-2610a79242b3 tempest-DeleteServersTestJSON-1135736220 tempest-DeleteServersTestJSON-1135736220-project] 10.222.0.26 "GET /compute/v2.1/servers/e848196a-c1b4-4e17-a748-aa877bce4650" status: 200 len: 1314 microversion: 2.1 time: 0.832143 Mar 05 02:52:14.033243 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 10/24] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:52:13 2022] GET /compute/v2.1/servers/e848196a-c1b4-4e17-a748-aa877bce4650 => generated 1314 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 02:52:15.055598 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-396c8992-301c-4107-9229-3b91ca9cff66 tempest-DeleteServersTestJSON-1135736220 tempest-DeleteServersTestJSON-1135736220-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:52:15.057815 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-396c8992-301c-4107-9229-3b91ca9cff66 tempest-DeleteServersTestJSON-1135736220 tempest-DeleteServersTestJSON-1135736220-project] [instance: e848196a-c1b4-4e17-a748-aa877bce4650] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:52:15.084376 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-396c8992-301c-4107-9229-3b91ca9cff66 tempest-DeleteServersTestJSON-1135736220 tempest-DeleteServersTestJSON-1135736220-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:52:15.086511 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-396c8992-301c-4107-9229-3b91ca9cff66 tempest-DeleteServersTestJSON-1135736220 tempest-DeleteServersTestJSON-1135736220-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:52:15.088532 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-396c8992-301c-4107-9229-3b91ca9cff66 tempest-DeleteServersTestJSON-1135736220 tempest-DeleteServersTestJSON-1135736220-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:52:15.089216 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-396c8992-301c-4107-9229-3b91ca9cff66 tempest-DeleteServersTestJSON-1135736220 tempest-DeleteServersTestJSON-1135736220-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:52:16.876180 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-396c8992-301c-4107-9229-3b91ca9cff66 tempest-DeleteServersTestJSON-1135736220 tempest-DeleteServersTestJSON-1135736220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22f302bdee4e47e79b975e5c0b88ff29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b241a841129430e93d2a9d0da408b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:52:16.893376 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-396c8992-301c-4107-9229-3b91ca9cff66 tempest-DeleteServersTestJSON-1135736220 tempest-DeleteServersTestJSON-1135736220-project] 10.222.0.26 "GET /compute/v2.1/servers/e848196a-c1b4-4e17-a748-aa877bce4650" status: 200 len: 1314 microversion: 2.1 time: 1.841411 Mar 05 02:52:16.896741 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 15/25] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:52:15 2022] GET /compute/v2.1/servers/e848196a-c1b4-4e17-a748-aa877bce4650 => generated 1314 bytes in 1849 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 02:52:17.914439 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-4972d28c-a815-4196-bcc5-9d8bbcb90982 tempest-DeleteServersTestJSON-1135736220 tempest-DeleteServersTestJSON-1135736220-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:52:17.915847 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-4972d28c-a815-4196-bcc5-9d8bbcb90982 tempest-DeleteServersTestJSON-1135736220 tempest-DeleteServersTestJSON-1135736220-project] [instance: e848196a-c1b4-4e17-a748-aa877bce4650] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:52:17.927758 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-4972d28c-a815-4196-bcc5-9d8bbcb90982 tempest-DeleteServersTestJSON-1135736220 tempest-DeleteServersTestJSON-1135736220-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:52:17.931165 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-4972d28c-a815-4196-bcc5-9d8bbcb90982 tempest-DeleteServersTestJSON-1135736220 tempest-DeleteServersTestJSON-1135736220-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:52:17.934538 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-4972d28c-a815-4196-bcc5-9d8bbcb90982 tempest-DeleteServersTestJSON-1135736220 tempest-DeleteServersTestJSON-1135736220-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:52:17.935601 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-4972d28c-a815-4196-bcc5-9d8bbcb90982 tempest-DeleteServersTestJSON-1135736220 tempest-DeleteServersTestJSON-1135736220-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:52:19.592400 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-95155326-142f-48d1-a9cb-4265212b5002 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Action: 'create', calling method: .version_select at 0x7f3f63a621f0>, body: {"keypair": {"name": "tempest-keypair-919844124"}} {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 02:52:19.677327 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-4972d28c-a815-4196-bcc5-9d8bbcb90982 tempest-DeleteServersTestJSON-1135736220 tempest-DeleteServersTestJSON-1135736220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22f302bdee4e47e79b975e5c0b88ff29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b241a841129430e93d2a9d0da408b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:52:19.689090 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-4972d28c-a815-4196-bcc5-9d8bbcb90982 tempest-DeleteServersTestJSON-1135736220 tempest-DeleteServersTestJSON-1135736220-project] 10.222.0.26 "GET /compute/v2.1/servers/e848196a-c1b4-4e17-a748-aa877bce4650" status: 200 len: 1314 microversion: 2.1 time: 1.779590 Mar 05 02:52:19.697107 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 11/26] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:52:17 2022] GET /compute/v2.1/servers/e848196a-c1b4-4e17-a748-aa877bce4650 => generated 1314 bytes in 1789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 02:52:19.731603 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.quota [None req-95155326-142f-48d1-a9cb-4265212b5002 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Getting quotas for project 533ddcf7f3bc4068a6f2856eb915ecb2. Resources: {'key_pairs'} {{(pid=123545) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 02:52:19.752970 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.quota [None req-95155326-142f-48d1-a9cb-4265212b5002 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Getting quotas for user c599ce47ad9147d29c93e3984b9652a8 and project 533ddcf7f3bc4068a6f2856eb915ecb2. Resources: {'key_pairs'} {{(pid=123545) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 02:52:20.713495 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-27c26dfe-86f6-4988-8c24-ee4a20fa2963 tempest-DeleteServersTestJSON-1135736220 tempest-DeleteServersTestJSON-1135736220-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:52:20.714813 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-27c26dfe-86f6-4988-8c24-ee4a20fa2963 tempest-DeleteServersTestJSON-1135736220 tempest-DeleteServersTestJSON-1135736220-project] [instance: e848196a-c1b4-4e17-a748-aa877bce4650] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:52:20.727785 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-27c26dfe-86f6-4988-8c24-ee4a20fa2963 tempest-DeleteServersTestJSON-1135736220 tempest-DeleteServersTestJSON-1135736220-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:52:20.729658 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-27c26dfe-86f6-4988-8c24-ee4a20fa2963 tempest-DeleteServersTestJSON-1135736220 tempest-DeleteServersTestJSON-1135736220-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:52:20.735869 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-27c26dfe-86f6-4988-8c24-ee4a20fa2963 tempest-DeleteServersTestJSON-1135736220 tempest-DeleteServersTestJSON-1135736220-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:52:20.736858 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-27c26dfe-86f6-4988-8c24-ee4a20fa2963 tempest-DeleteServersTestJSON-1135736220 tempest-DeleteServersTestJSON-1135736220-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:52:21.320044 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.quota [None req-95155326-142f-48d1-a9cb-4265212b5002 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Getting quotas for project 533ddcf7f3bc4068a6f2856eb915ecb2. Resources: {'key_pairs'} {{(pid=123545) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 02:52:21.329765 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.quota [None req-95155326-142f-48d1-a9cb-4265212b5002 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Getting quotas for user c599ce47ad9147d29c93e3984b9652a8 and project 533ddcf7f3bc4068a6f2856eb915ecb2. Resources: {'key_pairs'} {{(pid=123545) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 02:52:21.365284 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-95155326-142f-48d1-a9cb-4265212b5002 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 201 len: 2319 microversion: 2.20 time: 2.721466 Mar 05 02:52:21.367644 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 16/27] 10.222.0.26 () {62 vars in 1198 bytes} [Sat Mar 5 02:52:18 2022] POST /compute/v2.1/os-keypairs => generated 2319 bytes in 2724 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Mar 05 02:52:22.429259 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-b7461dfc-a7fe-4f9a-bb70-f83be89599a5 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-517155713", "imageRef": "adbc7df1-116e-4f9f-a28d-a6a3c084cceb", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 02:52:22.481013 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-27c26dfe-86f6-4988-8c24-ee4a20fa2963 tempest-DeleteServersTestJSON-1135736220 tempest-DeleteServersTestJSON-1135736220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22f302bdee4e47e79b975e5c0b88ff29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b241a841129430e93d2a9d0da408b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:52:22.490653 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-27c26dfe-86f6-4988-8c24-ee4a20fa2963 tempest-DeleteServersTestJSON-1135736220 tempest-DeleteServersTestJSON-1135736220-project] 10.222.0.26 "GET /compute/v2.1/servers/e848196a-c1b4-4e17-a748-aa877bce4650" status: 200 len: 1314 microversion: 2.1 time: 1.781432 Mar 05 02:52:22.491263 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 12/28] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:52:20 2022] GET /compute/v2.1/servers/e848196a-c1b4-4e17-a748-aa877bce4650 => generated 1314 bytes in 1783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 02:52:22.684459 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.network.neutron [None req-b7461dfc-a7fe-4f9a-bb70-f83be89599a5 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] validate_networks() for [('f9d1ff72-b3e0-444c-b935-4420329c224f', None, None, None, None, None)] {{(pid=123545) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 05 02:52:23.168468 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [req-ab215f60-3a16-4fab-8472-50cdc21834cb req-5ca85c44-307d-4ff9-bb2a-75589f690d72 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e848196a-c1b4-4e17-a748-aa877bce4650", "tag": "befe3005-c145-4b53-b393-98b7075cb75b"}]} {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 02:52:23.202034 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [req-ab215f60-3a16-4fab-8472-50cdc21834cb req-5ca85c44-307d-4ff9-bb2a-75589f690d72 service nova] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:52:23.202499 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [req-ab215f60-3a16-4fab-8472-50cdc21834cb req-5ca85c44-307d-4ff9-bb2a-75589f690d72 service nova] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:52:23.284756 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.compute.server_external_events [req-ab215f60-3a16-4fab-8472-50cdc21834cb req-5ca85c44-307d-4ff9-bb2a-75589f690d72 service nova] Creating event network-changed:befe3005-c145-4b53-b393-98b7075cb75b for instance e848196a-c1b4-4e17-a748-aa877bce4650 on hv-cinder-82725 Mar 05 02:52:23.285317 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [req-ab215f60-3a16-4fab-8472-50cdc21834cb req-5ca85c44-307d-4ff9-bb2a-75589f690d72 service nova] Acquired lock "compute-rpcapi-router" {{(pid=123546) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Mar 05 02:52:23.286606 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-1f28dae5-62ca-4dd9-becd-ab95c7f76b8a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:52:23.293277 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-1f28dae5-62ca-4dd9-becd-ab95c7f76b8a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:52:23.295138 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-1f28dae5-62ca-4dd9-becd-ab95c7f76b8a None None] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:52:23.298198 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-1f28dae5-62ca-4dd9-becd-ab95c7f76b8a None None] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:52:23.324633 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.compute.rpcapi [None req-1f28dae5-62ca-4dd9-becd-ab95c7f76b8a None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Mar 05 02:52:23.327031 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-1f28dae5-62ca-4dd9-becd-ab95c7f76b8a None None] Releasing lock "compute-rpcapi-router" {{(pid=123546) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Mar 05 02:52:23.387896 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-1f28dae5-62ca-4dd9-becd-ab95c7f76b8a None None] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.895399 Mar 05 02:52:23.388749 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 13/29] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Mar 5 02:52:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 02:52:23.508415 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-6c267a67-ff9b-41ed-8968-af635f87aa26 tempest-DeleteServersTestJSON-1135736220 tempest-DeleteServersTestJSON-1135736220-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:52:23.509120 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-6c267a67-ff9b-41ed-8968-af635f87aa26 tempest-DeleteServersTestJSON-1135736220 tempest-DeleteServersTestJSON-1135736220-project] [instance: e848196a-c1b4-4e17-a748-aa877bce4650] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:52:23.519915 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-6c267a67-ff9b-41ed-8968-af635f87aa26 tempest-DeleteServersTestJSON-1135736220 tempest-DeleteServersTestJSON-1135736220-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:52:23.533131 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-6c267a67-ff9b-41ed-8968-af635f87aa26 tempest-DeleteServersTestJSON-1135736220 tempest-DeleteServersTestJSON-1135736220-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:52:23.540287 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-6c267a67-ff9b-41ed-8968-af635f87aa26 tempest-DeleteServersTestJSON-1135736220 tempest-DeleteServersTestJSON-1135736220-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:52:23.540287 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-6c267a67-ff9b-41ed-8968-af635f87aa26 tempest-DeleteServersTestJSON-1135736220 tempest-DeleteServersTestJSON-1135736220-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:52:26.502978 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-6c267a67-ff9b-41ed-8968-af635f87aa26 tempest-DeleteServersTestJSON-1135736220 tempest-DeleteServersTestJSON-1135736220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22f302bdee4e47e79b975e5c0b88ff29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b241a841129430e93d2a9d0da408b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:52:26.519734 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-6c267a67-ff9b-41ed-8968-af635f87aa26 tempest-DeleteServersTestJSON-1135736220 tempest-DeleteServersTestJSON-1135736220-project] 10.222.0.26 "GET /compute/v2.1/servers/e848196a-c1b4-4e17-a748-aa877bce4650" status: 200 len: 1314 microversion: 2.1 time: 3.014404 Mar 05 02:52:26.523113 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 14/30] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:52:23 2022] GET /compute/v2.1/servers/e848196a-c1b4-4e17-a748-aa877bce4650 => generated 1314 bytes in 3019 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 02:52:26.570841 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-8e9b1d62-2345-49a5-82b5-bfa088de64ea tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1515644289", "imageRef": "adbc7df1-116e-4f9f-a28d-a6a3c084cceb", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "0e12fae2-ecda-45fd-a83a-e67cf08123e5"}], "security_groups": [{"name": "tempest-securitygroup--1371362937"}], "key_name": "tempest-keypair-919844124", "user_data": "}} {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 02:52:27.256763 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.network.neutron [None req-8e9b1d62-2345-49a5-82b5-bfa088de64ea tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] validate_networks() for [('0e12fae2-ecda-45fd-a83a-e67cf08123e5', None, None, None, None, None)] {{(pid=123546) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 05 02:52:27.932062 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.virt.hardware [None req-b7461dfc-a7fe-4f9a-bb70-f83be89599a5 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Flavor limits 0:0:0 {{(pid=123545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 05 02:52:27.932645 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.virt.hardware [None req-b7461dfc-a7fe-4f9a-bb70-f83be89599a5 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Image limits 0:0:0 {{(pid=123545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 05 02:52:27.933216 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.virt.hardware [None req-b7461dfc-a7fe-4f9a-bb70-f83be89599a5 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Flavor pref 0:0:0 {{(pid=123545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 05 02:52:27.933822 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.virt.hardware [None req-b7461dfc-a7fe-4f9a-bb70-f83be89599a5 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Image pref 0:0:0 {{(pid=123545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 05 02:52:27.934484 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.virt.hardware [None req-b7461dfc-a7fe-4f9a-bb70-f83be89599a5 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 05 02:52:27.950477 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-b7461dfc-a7fe-4f9a-bb70-f83be89599a5 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:52:27.951188 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-b7461dfc-a7fe-4f9a-bb70-f83be89599a5 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:52:27.952143 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-b7461dfc-a7fe-4f9a-bb70-f83be89599a5 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:52:27.952721 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-b7461dfc-a7fe-4f9a-bb70-f83be89599a5 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:52:27.984970 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.quota [None req-b7461dfc-a7fe-4f9a-bb70-f83be89599a5 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Getting quotas for project 8112a5759c444c1f94be24ab61bf072f. Resources: {'ram', 'cores', 'instances'} {{(pid=123545) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 02:52:27.991111 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.quota [None req-b7461dfc-a7fe-4f9a-bb70-f83be89599a5 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Getting quotas for user 90033e5e8e634b699bf050e36519f8fc and project 8112a5759c444c1f94be24ab61bf072f. Resources: {'ram', 'cores', 'instances'} {{(pid=123545) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 02:52:28.008947 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-b7461dfc-a7fe-4f9a-bb70-f83be89599a5 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Going to run 1 instances... {{(pid=123545) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 05 02:52:28.012738 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-b7461dfc-a7fe-4f9a-bb70-f83be89599a5 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] [instance: c24fee69-5bf4-40f4-ba18-56aecd12dd96] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='adbc7df1-116e-4f9f-a28d-a6a3c084cceb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123545) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 05 02:52:28.118218 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-b7461dfc-a7fe-4f9a-bb70-f83be89599a5 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 6.739005 Mar 05 02:52:28.119149 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 17/31] 10.222.0.26 () {60 vars in 1146 bytes} [Sat Mar 5 02:52:21 2022] POST /compute/v2.1/servers => generated 383 bytes in 6751 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 05 02:52:28.125483 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-73c9f4f1-a5c0-4fa7-941c-e36ca1fcddc2 tempest-DeleteServersTestJSON-1135736220 tempest-DeleteServersTestJSON-1135736220-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:52:28.126192 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-73c9f4f1-a5c0-4fa7-941c-e36ca1fcddc2 tempest-DeleteServersTestJSON-1135736220 tempest-DeleteServersTestJSON-1135736220-project] [instance: e848196a-c1b4-4e17-a748-aa877bce4650] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:52:28.148148 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-73c9f4f1-a5c0-4fa7-941c-e36ca1fcddc2 tempest-DeleteServersTestJSON-1135736220 tempest-DeleteServersTestJSON-1135736220-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:52:28.148522 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-73c9f4f1-a5c0-4fa7-941c-e36ca1fcddc2 tempest-DeleteServersTestJSON-1135736220 tempest-DeleteServersTestJSON-1135736220-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:52:28.149324 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-73c9f4f1-a5c0-4fa7-941c-e36ca1fcddc2 tempest-DeleteServersTestJSON-1135736220 tempest-DeleteServersTestJSON-1135736220-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:52:28.149770 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-73c9f4f1-a5c0-4fa7-941c-e36ca1fcddc2 tempest-DeleteServersTestJSON-1135736220 tempest-DeleteServersTestJSON-1135736220-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:52:28.423771 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.virt.hardware [None req-8e9b1d62-2345-49a5-82b5-bfa088de64ea tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Flavor limits 0:0:0 {{(pid=123546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 05 02:52:28.426203 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.virt.hardware [None req-8e9b1d62-2345-49a5-82b5-bfa088de64ea tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Image limits 0:0:0 {{(pid=123546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 05 02:52:28.426544 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-73c9f4f1-a5c0-4fa7-941c-e36ca1fcddc2 tempest-DeleteServersTestJSON-1135736220 tempest-DeleteServersTestJSON-1135736220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22f302bdee4e47e79b975e5c0b88ff29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b241a841129430e93d2a9d0da408b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:52:28.426866 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.virt.hardware [None req-8e9b1d62-2345-49a5-82b5-bfa088de64ea tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Flavor pref 0:0:0 {{(pid=123546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 05 02:52:28.428168 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.virt.hardware [None req-8e9b1d62-2345-49a5-82b5-bfa088de64ea tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Image pref 0:0:0 {{(pid=123546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 05 02:52:28.428808 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.virt.hardware [None req-8e9b1d62-2345-49a5-82b5-bfa088de64ea tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 05 02:52:28.435662 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-73c9f4f1-a5c0-4fa7-941c-e36ca1fcddc2 tempest-DeleteServersTestJSON-1135736220 tempest-DeleteServersTestJSON-1135736220-project] 10.222.0.26 "GET /compute/v2.1/servers/e848196a-c1b4-4e17-a748-aa877bce4650" status: 200 len: 1314 microversion: 2.1 time: 0.314997 Mar 05 02:52:28.437388 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 18/32] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:52:28 2022] GET /compute/v2.1/servers/e848196a-c1b4-4e17-a748-aa877bce4650 => generated 1314 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 02:52:28.450210 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-8e9b1d62-2345-49a5-82b5-bfa088de64ea tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:52:28.451248 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-8e9b1d62-2345-49a5-82b5-bfa088de64ea tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:52:28.452196 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-8e9b1d62-2345-49a5-82b5-bfa088de64ea tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:52:28.452750 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-8e9b1d62-2345-49a5-82b5-bfa088de64ea tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:52:28.473783 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.quota [None req-8e9b1d62-2345-49a5-82b5-bfa088de64ea tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Getting quotas for project 533ddcf7f3bc4068a6f2856eb915ecb2. Resources: {'ram', 'cores', 'instances'} {{(pid=123546) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 02:52:28.478544 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.quota [None req-8e9b1d62-2345-49a5-82b5-bfa088de64ea tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Getting quotas for user c599ce47ad9147d29c93e3984b9652a8 and project 533ddcf7f3bc4068a6f2856eb915ecb2. Resources: {'ram', 'cores', 'instances'} {{(pid=123546) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 02:52:28.491690 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-8e9b1d62-2345-49a5-82b5-bfa088de64ea tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Going to run 1 instances... {{(pid=123546) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 05 02:52:28.494084 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-8e9b1d62-2345-49a5-82b5-bfa088de64ea tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] [instance: e28e570d-3d50-4fe8-bb4a-fe0e95c20fb7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='adbc7df1-116e-4f9f-a28d-a6a3c084cceb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123546) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 05 02:52:28.600587 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-8e9b1d62-2345-49a5-82b5-bfa088de64ea tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 2.035206 Mar 05 02:52:28.607765 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 15/33] 10.222.0.26 () {62 vars in 1187 bytes} [Sat Mar 5 02:52:26 2022] POST /compute/v2.1/servers => generated 402 bytes in 2043 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Mar 05 02:52:28.615588 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-967d4de0-a683-4e1f-b78e-91617d091589 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:52:28.616735 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-967d4de0-a683-4e1f-b78e-91617d091589 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] [instance: c24fee69-5bf4-40f4-ba18-56aecd12dd96] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:52:28.717284 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-dbbcd338-fb54-4f03-82a9-f9d7b11f1df7 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Action: 'create', calling method: .version_select at 0x7f3f6317e5e0>, body: {"keypair": {"name": "tempest-keypair-1240062710"}} {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 02:52:28.754456 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.quota [None req-dbbcd338-fb54-4f03-82a9-f9d7b11f1df7 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Getting quotas for project b9d27da2e71d4962a53a95efc46518ea. Resources: {'key_pairs'} {{(pid=123545) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 02:52:28.760259 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.quota [None req-dbbcd338-fb54-4f03-82a9-f9d7b11f1df7 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Getting quotas for user 5e5a000087fe40419ccd0d1a96fb4783 and project b9d27da2e71d4962a53a95efc46518ea. Resources: {'key_pairs'} {{(pid=123545) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 02:52:28.834504 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-967d4de0-a683-4e1f-b78e-91617d091589 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90033e5e8e634b699bf050e36519f8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8112a5759c444c1f94be24ab61bf072f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:52:28.847455 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-967d4de0-a683-4e1f-b78e-91617d091589 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] 10.222.0.26 "GET /compute/v2.1/servers/c24fee69-5bf4-40f4-ba18-56aecd12dd96" status: 200 len: 1221 microversion: 2.1 time: 0.234542 Mar 05 02:52:28.848906 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 16/34] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:52:28 2022] GET /compute/v2.1/servers/c24fee69-5bf4-40f4-ba18-56aecd12dd96 => generated 1221 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 02:52:28.859584 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-402fbc2d-f3e9-4da7-af19-962da105398c tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:52:28.862925 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-402fbc2d-f3e9-4da7-af19-962da105398c tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] [instance: e28e570d-3d50-4fe8-bb4a-fe0e95c20fb7] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:52:29.087784 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.quota [None req-dbbcd338-fb54-4f03-82a9-f9d7b11f1df7 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Getting quotas for project b9d27da2e71d4962a53a95efc46518ea. Resources: {'key_pairs'} {{(pid=123545) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 02:52:29.094330 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-402fbc2d-f3e9-4da7-af19-962da105398c tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:52:29.101297 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.quota [None req-dbbcd338-fb54-4f03-82a9-f9d7b11f1df7 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Getting quotas for user 5e5a000087fe40419ccd0d1a96fb4783 and project b9d27da2e71d4962a53a95efc46518ea. Resources: {'key_pairs'} {{(pid=123545) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 02:52:29.110177 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-402fbc2d-f3e9-4da7-af19-962da105398c tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:52:29.114693 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-402fbc2d-f3e9-4da7-af19-962da105398c tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:52:29.126132 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-402fbc2d-f3e9-4da7-af19-962da105398c tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] 10.222.0.26 "GET /compute/v2.1/servers/e28e570d-3d50-4fe8-bb4a-fe0e95c20fb7" status: 200 len: 1281 microversion: 2.20 time: 0.265952 Mar 05 02:52:29.143340 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 17/35] 10.222.0.26 () {60 vars in 1276 bytes} [Sat Mar 5 02:52:28 2022] GET /compute/v2.1/servers/e28e570d-3d50-4fe8-bb4a-fe0e95c20fb7 => generated 1281 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 02:52:29.172569 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-0ce67e44-ae54-4fd5-9a8c-9dd0a24c2c05 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1953683680", "imageRef": "adbc7df1-116e-4f9f-a28d-a6a3c084cceb", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 02:52:29.179943 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-dbbcd338-fb54-4f03-82a9-f9d7b11f1df7 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 2301 microversion: 2.1 time: 0.739834 Mar 05 02:52:29.189678 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 19/36] 10.222.0.26 () {60 vars in 1157 bytes} [Sat Mar 5 02:52:28 2022] POST /compute/v2.1/os-keypairs => generated 2301 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 02:52:29.335211 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.network.neutron [None req-0ce67e44-ae54-4fd5-9a8c-9dd0a24c2c05 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] validate_networks() for [('f9d1ff72-b3e0-444c-b935-4420329c224f', None, None, None, None, None)] {{(pid=123546) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 05 02:52:29.458617 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-bb32c725-3e38-49bf-9dbc-78ef35193d50 tempest-DeleteServersTestJSON-1135736220 tempest-DeleteServersTestJSON-1135736220-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:52:29.458617 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-bb32c725-3e38-49bf-9dbc-78ef35193d50 tempest-DeleteServersTestJSON-1135736220 tempest-DeleteServersTestJSON-1135736220-project] [instance: e848196a-c1b4-4e17-a748-aa877bce4650] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:52:29.492173 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-bb32c725-3e38-49bf-9dbc-78ef35193d50 tempest-DeleteServersTestJSON-1135736220 tempest-DeleteServersTestJSON-1135736220-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:52:29.495738 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-bb32c725-3e38-49bf-9dbc-78ef35193d50 tempest-DeleteServersTestJSON-1135736220 tempest-DeleteServersTestJSON-1135736220-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:52:29.503855 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-bb32c725-3e38-49bf-9dbc-78ef35193d50 tempest-DeleteServersTestJSON-1135736220 tempest-DeleteServersTestJSON-1135736220-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:52:29.505251 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-bb32c725-3e38-49bf-9dbc-78ef35193d50 tempest-DeleteServersTestJSON-1135736220 tempest-DeleteServersTestJSON-1135736220-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:52:29.942784 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-bb32c725-3e38-49bf-9dbc-78ef35193d50 tempest-DeleteServersTestJSON-1135736220 tempest-DeleteServersTestJSON-1135736220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22f302bdee4e47e79b975e5c0b88ff29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b241a841129430e93d2a9d0da408b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:52:29.953030 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-bb32c725-3e38-49bf-9dbc-78ef35193d50 tempest-DeleteServersTestJSON-1135736220 tempest-DeleteServersTestJSON-1135736220-project] 10.222.0.26 "GET /compute/v2.1/servers/e848196a-c1b4-4e17-a748-aa877bce4650" status: 200 len: 1314 microversion: 2.1 time: 0.501576 Mar 05 02:52:29.955140 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 20/37] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:52:29 2022] GET /compute/v2.1/servers/e848196a-c1b4-4e17-a748-aa877bce4650 => generated 1314 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 02:52:30.161869 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-03439e9a-fca7-4789-a47b-f5d132a3729e tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:52:30.163267 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-03439e9a-fca7-4789-a47b-f5d132a3729e tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] [instance: e28e570d-3d50-4fe8-bb4a-fe0e95c20fb7] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:52:30.174103 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-03439e9a-fca7-4789-a47b-f5d132a3729e tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:52:30.174705 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-03439e9a-fca7-4789-a47b-f5d132a3729e tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:52:30.175649 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-03439e9a-fca7-4789-a47b-f5d132a3729e tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:52:30.176103 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-03439e9a-fca7-4789-a47b-f5d132a3729e tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:52:30.301013 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-03439e9a-fca7-4789-a47b-f5d132a3729e tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:52:30.314755 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-03439e9a-fca7-4789-a47b-f5d132a3729e tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:52:30.319204 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-03439e9a-fca7-4789-a47b-f5d132a3729e tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:52:30.322466 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-03439e9a-fca7-4789-a47b-f5d132a3729e tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] 10.222.0.26 "GET /compute/v2.1/servers/e28e570d-3d50-4fe8-bb4a-fe0e95c20fb7" status: 200 len: 1285 microversion: 2.20 time: 0.162743 Mar 05 02:52:30.323211 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 21/38] 10.222.0.26 () {60 vars in 1276 bytes} [Sat Mar 5 02:52:30 2022] GET /compute/v2.1/servers/e28e570d-3d50-4fe8-bb4a-fe0e95c20fb7 => generated 1285 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 02:52:30.342138 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.virt.hardware [None req-0ce67e44-ae54-4fd5-9a8c-9dd0a24c2c05 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Flavor limits 0:0:0 {{(pid=123546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 05 02:52:30.342750 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.virt.hardware [None req-0ce67e44-ae54-4fd5-9a8c-9dd0a24c2c05 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Image limits 0:0:0 {{(pid=123546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 05 02:52:30.343583 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.virt.hardware [None req-0ce67e44-ae54-4fd5-9a8c-9dd0a24c2c05 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Flavor pref 0:0:0 {{(pid=123546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 05 02:52:30.344914 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.virt.hardware [None req-0ce67e44-ae54-4fd5-9a8c-9dd0a24c2c05 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Image pref 0:0:0 {{(pid=123546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 05 02:52:30.345691 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.virt.hardware [None req-0ce67e44-ae54-4fd5-9a8c-9dd0a24c2c05 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 05 02:52:30.360627 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-0ce67e44-ae54-4fd5-9a8c-9dd0a24c2c05 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:52:30.376252 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-0ce67e44-ae54-4fd5-9a8c-9dd0a24c2c05 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:52:30.378277 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-0ce67e44-ae54-4fd5-9a8c-9dd0a24c2c05 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:52:30.380158 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-0ce67e44-ae54-4fd5-9a8c-9dd0a24c2c05 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:52:30.435509 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.quota [None req-0ce67e44-ae54-4fd5-9a8c-9dd0a24c2c05 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Getting quotas for project 8112a5759c444c1f94be24ab61bf072f. Resources: {'ram', 'cores', 'instances'} {{(pid=123546) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 02:52:30.439885 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.quota [None req-0ce67e44-ae54-4fd5-9a8c-9dd0a24c2c05 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Getting quotas for user 90033e5e8e634b699bf050e36519f8fc and project 8112a5759c444c1f94be24ab61bf072f. Resources: {'ram', 'cores', 'instances'} {{(pid=123546) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 02:52:30.452894 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-0ce67e44-ae54-4fd5-9a8c-9dd0a24c2c05 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Going to run 1 instances... {{(pid=123546) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 05 02:52:30.455400 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-0ce67e44-ae54-4fd5-9a8c-9dd0a24c2c05 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] [instance: 39e14280-8730-41d3-993e-a158f0029386] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='adbc7df1-116e-4f9f-a28d-a6a3c084cceb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123546) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 05 02:52:30.552256 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-0ce67e44-ae54-4fd5-9a8c-9dd0a24c2c05 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.407763 Mar 05 02:52:30.553222 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 18/39] 10.222.0.26 () {60 vars in 1146 bytes} [Sat Mar 5 02:52:29 2022] POST /compute/v2.1/servers => generated 383 bytes in 1409 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 05 02:52:30.569763 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-5bba980f-2a4f-4c96-94e4-460bf03c6ad0 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:52:30.570604 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-5bba980f-2a4f-4c96-94e4-460bf03c6ad0 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] [instance: 39e14280-8730-41d3-993e-a158f0029386] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:52:30.678374 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-5bba980f-2a4f-4c96-94e4-460bf03c6ad0 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90033e5e8e634b699bf050e36519f8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8112a5759c444c1f94be24ab61bf072f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:52:30.690838 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-5bba980f-2a4f-4c96-94e4-460bf03c6ad0 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] 10.222.0.26 "GET /compute/v2.1/servers/39e14280-8730-41d3-993e-a158f0029386" status: 200 len: 1222 microversion: 2.1 time: 0.129949 Mar 05 02:52:30.692721 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 22/40] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:52:30 2022] GET /compute/v2.1/servers/39e14280-8730-41d3-993e-a158f0029386 => generated 1222 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 02:52:30.972723 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-0b442c32-5837-40bc-a983-52df63fbdedb tempest-DeleteServersTestJSON-1135736220 tempest-DeleteServersTestJSON-1135736220-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:52:30.974331 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-0b442c32-5837-40bc-a983-52df63fbdedb tempest-DeleteServersTestJSON-1135736220 tempest-DeleteServersTestJSON-1135736220-project] [instance: e848196a-c1b4-4e17-a748-aa877bce4650] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:52:30.981194 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-0b442c32-5837-40bc-a983-52df63fbdedb tempest-DeleteServersTestJSON-1135736220 tempest-DeleteServersTestJSON-1135736220-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:52:30.982211 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-0b442c32-5837-40bc-a983-52df63fbdedb tempest-DeleteServersTestJSON-1135736220 tempest-DeleteServersTestJSON-1135736220-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:52:30.982440 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-0b442c32-5837-40bc-a983-52df63fbdedb tempest-DeleteServersTestJSON-1135736220 tempest-DeleteServersTestJSON-1135736220-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:52:30.987992 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-0b442c32-5837-40bc-a983-52df63fbdedb tempest-DeleteServersTestJSON-1135736220 tempest-DeleteServersTestJSON-1135736220-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:52:31.195857 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-0b442c32-5837-40bc-a983-52df63fbdedb tempest-DeleteServersTestJSON-1135736220 tempest-DeleteServersTestJSON-1135736220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22f302bdee4e47e79b975e5c0b88ff29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b241a841129430e93d2a9d0da408b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:52:31.205109 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-0b442c32-5837-40bc-a983-52df63fbdedb tempest-DeleteServersTestJSON-1135736220 tempest-DeleteServersTestJSON-1135736220-project] 10.222.0.26 "GET /compute/v2.1/servers/e848196a-c1b4-4e17-a748-aa877bce4650" status: 200 len: 1314 microversion: 2.1 time: 0.238111 Mar 05 02:52:31.205736 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 19/41] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:52:30 2022] GET /compute/v2.1/servers/e848196a-c1b4-4e17-a748-aa877bce4650 => generated 1314 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 02:52:31.346563 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-37049047-d8a8-412e-ae3e-1d9df55fee77 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:52:31.347482 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-37049047-d8a8-412e-ae3e-1d9df55fee77 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] [instance: e28e570d-3d50-4fe8-bb4a-fe0e95c20fb7] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:52:31.354627 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-37049047-d8a8-412e-ae3e-1d9df55fee77 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:52:31.356410 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-37049047-d8a8-412e-ae3e-1d9df55fee77 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:52:31.357624 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-37049047-d8a8-412e-ae3e-1d9df55fee77 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:52:31.358504 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-37049047-d8a8-412e-ae3e-1d9df55fee77 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:52:31.435243 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-37049047-d8a8-412e-ae3e-1d9df55fee77 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:52:31.443971 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-37049047-d8a8-412e-ae3e-1d9df55fee77 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:52:31.445502 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-37049047-d8a8-412e-ae3e-1d9df55fee77 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:52:31.446669 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-37049047-d8a8-412e-ae3e-1d9df55fee77 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] 10.222.0.26 "GET /compute/v2.1/servers/e28e570d-3d50-4fe8-bb4a-fe0e95c20fb7" status: 200 len: 1285 microversion: 2.20 time: 0.106197 Mar 05 02:52:31.448573 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 23/42] 10.222.0.26 () {60 vars in 1276 bytes} [Sat Mar 5 02:52:31 2022] GET /compute/v2.1/servers/e28e570d-3d50-4fe8-bb4a-fe0e95c20fb7 => generated 1285 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 02:52:31.709603 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-6c03fcea-bc9d-4c20-85ec-8b89f20baa20 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:52:31.710573 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-6c03fcea-bc9d-4c20-85ec-8b89f20baa20 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] [instance: 39e14280-8730-41d3-993e-a158f0029386] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:52:31.717051 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-6c03fcea-bc9d-4c20-85ec-8b89f20baa20 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:52:31.717911 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-6c03fcea-bc9d-4c20-85ec-8b89f20baa20 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:52:31.719600 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-6c03fcea-bc9d-4c20-85ec-8b89f20baa20 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:52:31.720747 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-6c03fcea-bc9d-4c20-85ec-8b89f20baa20 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:52:31.786923 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-a5d4ea65-005d-45df-85af-54ac21ba1c31 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-701582578", "imageRef": "adbc7df1-116e-4f9f-a28d-a6a3c084cceb", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "691722ee-1aea-4c34-b285-794aff5b5741"}], "security_groups": [{"name": "tempest-securitygroup--1697080934"}], "key_name": "tempest-keypair-1240062710", "user_data": "}} {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 02:52:31.796352 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-6c03fcea-bc9d-4c20-85ec-8b89f20baa20 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90033e5e8e634b699bf050e36519f8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8112a5759c444c1f94be24ab61bf072f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:52:31.806996 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-6c03fcea-bc9d-4c20-85ec-8b89f20baa20 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] 10.222.0.26 "GET /compute/v2.1/servers/39e14280-8730-41d3-993e-a158f0029386" status: 200 len: 1226 microversion: 2.1 time: 0.101168 Mar 05 02:52:31.808030 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 20/43] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:52:31 2022] GET /compute/v2.1/servers/39e14280-8730-41d3-993e-a158f0029386 => generated 1226 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 02:52:31.908980 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.network.neutron [None req-a5d4ea65-005d-45df-85af-54ac21ba1c31 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] validate_networks() for [('691722ee-1aea-4c34-b285-794aff5b5741', None, None, None, None, None)] {{(pid=123545) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 05 02:52:32.224094 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-fa3eda83-2102-48c5-97be-2224df696777 tempest-DeleteServersTestJSON-1135736220 tempest-DeleteServersTestJSON-1135736220-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:52:32.225069 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-fa3eda83-2102-48c5-97be-2224df696777 tempest-DeleteServersTestJSON-1135736220 tempest-DeleteServersTestJSON-1135736220-project] [instance: e848196a-c1b4-4e17-a748-aa877bce4650] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:52:32.246591 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-fa3eda83-2102-48c5-97be-2224df696777 tempest-DeleteServersTestJSON-1135736220 tempest-DeleteServersTestJSON-1135736220-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:52:32.248729 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-fa3eda83-2102-48c5-97be-2224df696777 tempest-DeleteServersTestJSON-1135736220 tempest-DeleteServersTestJSON-1135736220-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:52:32.253084 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-fa3eda83-2102-48c5-97be-2224df696777 tempest-DeleteServersTestJSON-1135736220 tempest-DeleteServersTestJSON-1135736220-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:52:32.254019 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-fa3eda83-2102-48c5-97be-2224df696777 tempest-DeleteServersTestJSON-1135736220 tempest-DeleteServersTestJSON-1135736220-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:52:33.341796 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-fa3eda83-2102-48c5-97be-2224df696777 tempest-DeleteServersTestJSON-1135736220 tempest-DeleteServersTestJSON-1135736220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22f302bdee4e47e79b975e5c0b88ff29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b241a841129430e93d2a9d0da408b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:52:33.355753 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-fa3eda83-2102-48c5-97be-2224df696777 tempest-DeleteServersTestJSON-1135736220 tempest-DeleteServersTestJSON-1135736220-project] 10.222.0.26 "GET /compute/v2.1/servers/e848196a-c1b4-4e17-a748-aa877bce4650" status: 200 len: 1314 microversion: 2.1 time: 1.133302 Mar 05 02:52:33.356910 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 21/44] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:52:32 2022] GET /compute/v2.1/servers/e848196a-c1b4-4e17-a748-aa877bce4650 => generated 1314 bytes in 1139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 02:52:33.379888 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-54b79469-5e35-493a-a478-53deb20ba5cd tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:52:33.381918 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-54b79469-5e35-493a-a478-53deb20ba5cd tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] [instance: e28e570d-3d50-4fe8-bb4a-fe0e95c20fb7] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:52:33.403051 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-54b79469-5e35-493a-a478-53deb20ba5cd tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:52:33.404123 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-54b79469-5e35-493a-a478-53deb20ba5cd tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:52:33.409977 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-54b79469-5e35-493a-a478-53deb20ba5cd tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:52:33.411852 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-54b79469-5e35-493a-a478-53deb20ba5cd tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:52:33.562750 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-54b79469-5e35-493a-a478-53deb20ba5cd tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:52:33.599477 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-54b79469-5e35-493a-a478-53deb20ba5cd tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:52:33.602868 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-54b79469-5e35-493a-a478-53deb20ba5cd tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:52:33.623862 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-54b79469-5e35-493a-a478-53deb20ba5cd tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] 10.222.0.26 "GET /compute/v2.1/servers/e28e570d-3d50-4fe8-bb4a-fe0e95c20fb7" status: 200 len: 1339 microversion: 2.20 time: 0.260891 Mar 05 02:52:33.637389 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 22/45] 10.222.0.26 () {60 vars in 1276 bytes} [Sat Mar 5 02:52:33 2022] GET /compute/v2.1/servers/e28e570d-3d50-4fe8-bb4a-fe0e95c20fb7 => generated 1339 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 02:52:33.637389 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-ac727bbd-62fc-424a-a9f4-ddf8882bc073 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:52:33.649539 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-ac727bbd-62fc-424a-a9f4-ddf8882bc073 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] [instance: 39e14280-8730-41d3-993e-a158f0029386] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:52:33.667016 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-ac727bbd-62fc-424a-a9f4-ddf8882bc073 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:52:33.667758 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-ac727bbd-62fc-424a-a9f4-ddf8882bc073 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:52:33.669779 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-ac727bbd-62fc-424a-a9f4-ddf8882bc073 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:52:33.670537 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-ac727bbd-62fc-424a-a9f4-ddf8882bc073 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:52:33.792022 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-ac727bbd-62fc-424a-a9f4-ddf8882bc073 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90033e5e8e634b699bf050e36519f8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8112a5759c444c1f94be24ab61bf072f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:52:33.806268 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-ac727bbd-62fc-424a-a9f4-ddf8882bc073 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] 10.222.0.26 "GET /compute/v2.1/servers/39e14280-8730-41d3-993e-a158f0029386" status: 200 len: 1280 microversion: 2.1 time: 0.177438 Mar 05 02:52:33.806873 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 23/46] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:52:33 2022] GET /compute/v2.1/servers/39e14280-8730-41d3-993e-a158f0029386 => generated 1280 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 02:52:33.889012 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.virt.hardware [None req-a5d4ea65-005d-45df-85af-54ac21ba1c31 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Flavor limits 0:0:0 {{(pid=123545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 05 02:52:33.889507 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.virt.hardware [None req-a5d4ea65-005d-45df-85af-54ac21ba1c31 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Image limits 0:0:0 {{(pid=123545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 05 02:52:33.890308 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.virt.hardware [None req-a5d4ea65-005d-45df-85af-54ac21ba1c31 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Flavor pref 0:0:0 {{(pid=123545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 05 02:52:33.891778 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.virt.hardware [None req-a5d4ea65-005d-45df-85af-54ac21ba1c31 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Image pref 0:0:0 {{(pid=123545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 05 02:52:33.892003 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.virt.hardware [None req-a5d4ea65-005d-45df-85af-54ac21ba1c31 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 05 02:52:33.900967 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-a5d4ea65-005d-45df-85af-54ac21ba1c31 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:52:33.902034 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-a5d4ea65-005d-45df-85af-54ac21ba1c31 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:52:33.903181 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-a5d4ea65-005d-45df-85af-54ac21ba1c31 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:52:33.904752 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-a5d4ea65-005d-45df-85af-54ac21ba1c31 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:52:33.967438 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.quota [None req-a5d4ea65-005d-45df-85af-54ac21ba1c31 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Getting quotas for project b9d27da2e71d4962a53a95efc46518ea. Resources: {'ram', 'cores', 'instances'} {{(pid=123545) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 02:52:33.983986 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.quota [None req-a5d4ea65-005d-45df-85af-54ac21ba1c31 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Getting quotas for user 5e5a000087fe40419ccd0d1a96fb4783 and project b9d27da2e71d4962a53a95efc46518ea. Resources: {'ram', 'cores', 'instances'} {{(pid=123545) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 02:52:34.025333 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-a5d4ea65-005d-45df-85af-54ac21ba1c31 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Going to run 1 instances... {{(pid=123545) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 05 02:52:34.031145 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-a5d4ea65-005d-45df-85af-54ac21ba1c31 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] [instance: d0080e4b-6532-4e0c-8d19-cfbdf32e401b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='adbc7df1-116e-4f9f-a28d-a6a3c084cceb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123545) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 05 02:52:34.206000 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-a5d4ea65-005d-45df-85af-54ac21ba1c31 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.423396 Mar 05 02:52:34.212929 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 24/47] 10.222.0.26 () {60 vars in 1146 bytes} [Sat Mar 5 02:52:31 2022] POST /compute/v2.1/servers => generated 402 bytes in 2431 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Mar 05 02:52:34.225242 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-289ea612-b1dd-46d9-833e-7c99f75917c0 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:52:34.226653 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-289ea612-b1dd-46d9-833e-7c99f75917c0 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] [instance: d0080e4b-6532-4e0c-8d19-cfbdf32e401b] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:52:34.376685 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-f572609c-4fa0-4f45-919f-e85b9c46fc00 tempest-DeleteServersTestJSON-1135736220 tempest-DeleteServersTestJSON-1135736220-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:52:34.377557 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-f572609c-4fa0-4f45-919f-e85b9c46fc00 tempest-DeleteServersTestJSON-1135736220 tempest-DeleteServersTestJSON-1135736220-project] [instance: e848196a-c1b4-4e17-a748-aa877bce4650] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:52:34.378694 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-289ea612-b1dd-46d9-833e-7c99f75917c0 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e5a000087fe40419ccd0d1a96fb4783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9d27da2e71d4962a53a95efc46518ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:52:34.386440 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-f572609c-4fa0-4f45-919f-e85b9c46fc00 tempest-DeleteServersTestJSON-1135736220 tempest-DeleteServersTestJSON-1135736220-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:52:34.394446 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-289ea612-b1dd-46d9-833e-7c99f75917c0 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] 10.222.0.26 "GET /compute/v2.1/servers/d0080e4b-6532-4e0c-8d19-cfbdf32e401b" status: 200 len: 1237 microversion: 2.1 time: 0.175147 Mar 05 02:52:34.394668 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-f572609c-4fa0-4f45-919f-e85b9c46fc00 tempest-DeleteServersTestJSON-1135736220 tempest-DeleteServersTestJSON-1135736220-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:52:34.396108 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-f572609c-4fa0-4f45-919f-e85b9c46fc00 tempest-DeleteServersTestJSON-1135736220 tempest-DeleteServersTestJSON-1135736220-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:52:34.397304 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 24/48] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:52:34 2022] GET /compute/v2.1/servers/d0080e4b-6532-4e0c-8d19-cfbdf32e401b => generated 1237 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 02:52:34.397664 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-f572609c-4fa0-4f45-919f-e85b9c46fc00 tempest-DeleteServersTestJSON-1135736220 tempest-DeleteServersTestJSON-1135736220-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:52:34.650142 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-04525b5e-556e-4319-96d5-1ce0723a6f27 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:52:34.650881 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-04525b5e-556e-4319-96d5-1ce0723a6f27 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] [instance: e28e570d-3d50-4fe8-bb4a-fe0e95c20fb7] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:52:34.669044 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-04525b5e-556e-4319-96d5-1ce0723a6f27 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:52:34.675632 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-04525b5e-556e-4319-96d5-1ce0723a6f27 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:52:34.678036 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-04525b5e-556e-4319-96d5-1ce0723a6f27 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:52:34.679205 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-04525b5e-556e-4319-96d5-1ce0723a6f27 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:52:34.822325 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-04525b5e-556e-4319-96d5-1ce0723a6f27 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:52:34.837912 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-04525b5e-556e-4319-96d5-1ce0723a6f27 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:52:34.847786 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-04525b5e-556e-4319-96d5-1ce0723a6f27 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:52:34.849724 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-04525b5e-556e-4319-96d5-1ce0723a6f27 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] 10.222.0.26 "GET /compute/v2.1/servers/e28e570d-3d50-4fe8-bb4a-fe0e95c20fb7" status: 200 len: 1339 microversion: 2.20 time: 0.207432 Mar 05 02:52:34.850706 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 25/49] 10.222.0.26 () {60 vars in 1276 bytes} [Sat Mar 5 02:52:34 2022] GET /compute/v2.1/servers/e28e570d-3d50-4fe8-bb4a-fe0e95c20fb7 => generated 1339 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 02:52:34.968660 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [req-2d88caaa-a1e3-4c54-b743-f58e876e9955 req-4c840e7f-b416-410f-880d-2309184c5bd6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e848196a-c1b4-4e17-a748-aa877bce4650", "name": "network-vif-plugged", "status": "completed", "tag": "befe3005-c145-4b53-b393-98b7075cb75b"}]} {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 02:52:34.984437 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [req-2d88caaa-a1e3-4c54-b743-f58e876e9955 req-4c840e7f-b416-410f-880d-2309184c5bd6 service nova] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:52:34.985059 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [req-2d88caaa-a1e3-4c54-b743-f58e876e9955 req-4c840e7f-b416-410f-880d-2309184c5bd6 service nova] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:52:35.013800 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.compute.server_external_events [req-2d88caaa-a1e3-4c54-b743-f58e876e9955 req-4c840e7f-b416-410f-880d-2309184c5bd6 service nova] Creating event network-vif-plugged:befe3005-c145-4b53-b393-98b7075cb75b for instance e848196a-c1b4-4e17-a748-aa877bce4650 on hv-cinder-82725 Mar 05 02:52:35.024331 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [req-2d88caaa-a1e3-4c54-b743-f58e876e9955 req-4c840e7f-b416-410f-880d-2309184c5bd6 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.171956 Mar 05 02:52:35.025585 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 26/50] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Mar 5 02:52:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 02:52:35.033936 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-606a1f8c-9156-4566-8fc7-f7001b6a5a94 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:52:35.034963 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-606a1f8c-9156-4566-8fc7-f7001b6a5a94 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] [instance: 39e14280-8730-41d3-993e-a158f0029386] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:52:35.042413 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-606a1f8c-9156-4566-8fc7-f7001b6a5a94 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:52:35.043434 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-606a1f8c-9156-4566-8fc7-f7001b6a5a94 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:52:35.044439 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-606a1f8c-9156-4566-8fc7-f7001b6a5a94 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:52:35.045016 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-606a1f8c-9156-4566-8fc7-f7001b6a5a94 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:52:35.309354 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-f572609c-4fa0-4f45-919f-e85b9c46fc00 tempest-DeleteServersTestJSON-1135736220 tempest-DeleteServersTestJSON-1135736220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22f302bdee4e47e79b975e5c0b88ff29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b241a841129430e93d2a9d0da408b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:52:35.320118 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-f572609c-4fa0-4f45-919f-e85b9c46fc00 tempest-DeleteServersTestJSON-1135736220 tempest-DeleteServersTestJSON-1135736220-project] 10.222.0.26 "GET /compute/v2.1/servers/e848196a-c1b4-4e17-a748-aa877bce4650" status: 200 len: 1314 microversion: 2.1 time: 0.948129 Mar 05 02:52:35.326146 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 25/51] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:52:34 2022] GET /compute/v2.1/servers/e848196a-c1b4-4e17-a748-aa877bce4650 => generated 1314 bytes in 953 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 02:52:35.414850 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-cd5a00a2-b26b-4b1f-af0d-c699a4731a11 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:52:35.415704 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-cd5a00a2-b26b-4b1f-af0d-c699a4731a11 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] [instance: d0080e4b-6532-4e0c-8d19-cfbdf32e401b] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:52:35.426078 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-cd5a00a2-b26b-4b1f-af0d-c699a4731a11 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:52:35.430739 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-cd5a00a2-b26b-4b1f-af0d-c699a4731a11 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:52:35.446873 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-cd5a00a2-b26b-4b1f-af0d-c699a4731a11 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:52:35.449364 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-cd5a00a2-b26b-4b1f-af0d-c699a4731a11 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:52:35.570144 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-cd5a00a2-b26b-4b1f-af0d-c699a4731a11 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e5a000087fe40419ccd0d1a96fb4783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9d27da2e71d4962a53a95efc46518ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:52:35.587203 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-cd5a00a2-b26b-4b1f-af0d-c699a4731a11 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] 10.222.0.26 "GET /compute/v2.1/servers/d0080e4b-6532-4e0c-8d19-cfbdf32e401b" status: 200 len: 1289 microversion: 2.1 time: 0.177535 Mar 05 02:52:35.599452 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 26/52] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:52:35 2022] GET /compute/v2.1/servers/d0080e4b-6532-4e0c-8d19-cfbdf32e401b => generated 1289 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 02:52:35.667516 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-606a1f8c-9156-4566-8fc7-f7001b6a5a94 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90033e5e8e634b699bf050e36519f8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8112a5759c444c1f94be24ab61bf072f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:52:35.679208 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-606a1f8c-9156-4566-8fc7-f7001b6a5a94 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] 10.222.0.26 "GET /compute/v2.1/servers/39e14280-8730-41d3-993e-a158f0029386" status: 200 len: 1322 microversion: 2.1 time: 0.650951 Mar 05 02:52:35.680537 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 27/53] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:52:35 2022] GET /compute/v2.1/servers/39e14280-8730-41d3-993e-a158f0029386 => generated 1322 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 02:52:35.871957 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-b98e18f4-f10a-4105-b9ad-c0394124d282 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:52:35.873196 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-b98e18f4-f10a-4105-b9ad-c0394124d282 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] [instance: e28e570d-3d50-4fe8-bb4a-fe0e95c20fb7] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:52:35.884202 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-b98e18f4-f10a-4105-b9ad-c0394124d282 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:52:35.884889 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-b98e18f4-f10a-4105-b9ad-c0394124d282 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:52:35.886104 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-b98e18f4-f10a-4105-b9ad-c0394124d282 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:52:35.886864 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-b98e18f4-f10a-4105-b9ad-c0394124d282 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:52:36.343221 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-801f4573-87e2-4df6-aa08-cf942a8ed46f tempest-DeleteServersTestJSON-1135736220 tempest-DeleteServersTestJSON-1135736220-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:52:36.343833 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-801f4573-87e2-4df6-aa08-cf942a8ed46f tempest-DeleteServersTestJSON-1135736220 tempest-DeleteServersTestJSON-1135736220-project] [instance: e848196a-c1b4-4e17-a748-aa877bce4650] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:52:36.350644 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-801f4573-87e2-4df6-aa08-cf942a8ed46f tempest-DeleteServersTestJSON-1135736220 tempest-DeleteServersTestJSON-1135736220-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:52:36.351326 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-801f4573-87e2-4df6-aa08-cf942a8ed46f tempest-DeleteServersTestJSON-1135736220 tempest-DeleteServersTestJSON-1135736220-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:52:36.352379 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-801f4573-87e2-4df6-aa08-cf942a8ed46f tempest-DeleteServersTestJSON-1135736220 tempest-DeleteServersTestJSON-1135736220-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:52:36.352761 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-801f4573-87e2-4df6-aa08-cf942a8ed46f tempest-DeleteServersTestJSON-1135736220 tempest-DeleteServersTestJSON-1135736220-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:52:36.521694 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-b98e18f4-f10a-4105-b9ad-c0394124d282 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:52:36.536109 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-b98e18f4-f10a-4105-b9ad-c0394124d282 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:52:36.539201 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-b98e18f4-f10a-4105-b9ad-c0394124d282 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:52:36.540907 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-b98e18f4-f10a-4105-b9ad-c0394124d282 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] 10.222.0.26 "GET /compute/v2.1/servers/e28e570d-3d50-4fe8-bb4a-fe0e95c20fb7" status: 200 len: 1407 microversion: 2.20 time: 0.675752 Mar 05 02:52:36.543945 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 27/54] 10.222.0.26 () {60 vars in 1276 bytes} [Sat Mar 5 02:52:35 2022] GET /compute/v2.1/servers/e28e570d-3d50-4fe8-bb4a-fe0e95c20fb7 => generated 1407 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 02:52:36.612828 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-d3b77c97-090c-4dd2-8ef6-361392df48e6 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:52:36.616071 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-d3b77c97-090c-4dd2-8ef6-361392df48e6 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] [instance: d0080e4b-6532-4e0c-8d19-cfbdf32e401b] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:52:36.631367 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-d3b77c97-090c-4dd2-8ef6-361392df48e6 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:52:36.642083 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-d3b77c97-090c-4dd2-8ef6-361392df48e6 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:52:36.643118 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-d3b77c97-090c-4dd2-8ef6-361392df48e6 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:52:36.643587 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-d3b77c97-090c-4dd2-8ef6-361392df48e6 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:52:36.849908 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-d3b77c97-090c-4dd2-8ef6-361392df48e6 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e5a000087fe40419ccd0d1a96fb4783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9d27da2e71d4962a53a95efc46518ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:52:36.860935 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-d3b77c97-090c-4dd2-8ef6-361392df48e6 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] 10.222.0.26 "GET /compute/v2.1/servers/d0080e4b-6532-4e0c-8d19-cfbdf32e401b" status: 200 len: 1295 microversion: 2.1 time: 0.258930 Mar 05 02:52:36.861643 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 28/55] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:52:36 2022] GET /compute/v2.1/servers/d0080e4b-6532-4e0c-8d19-cfbdf32e401b => generated 1295 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 02:52:36.874789 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-4ba689e7-0b99-4491-a082-8ff9f9b181c2 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:52:36.876708 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-4ba689e7-0b99-4491-a082-8ff9f9b181c2 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] [instance: 39e14280-8730-41d3-993e-a158f0029386] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:52:36.894899 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-4ba689e7-0b99-4491-a082-8ff9f9b181c2 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:52:36.895365 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-4ba689e7-0b99-4491-a082-8ff9f9b181c2 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:52:36.896162 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-4ba689e7-0b99-4491-a082-8ff9f9b181c2 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:52:36.896623 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-4ba689e7-0b99-4491-a082-8ff9f9b181c2 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:52:37.025371 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-801f4573-87e2-4df6-aa08-cf942a8ed46f tempest-DeleteServersTestJSON-1135736220 tempest-DeleteServersTestJSON-1135736220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22f302bdee4e47e79b975e5c0b88ff29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b241a841129430e93d2a9d0da408b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:52:37.049071 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-801f4573-87e2-4df6-aa08-cf942a8ed46f tempest-DeleteServersTestJSON-1135736220 tempest-DeleteServersTestJSON-1135736220-project] 10.222.0.26 "GET /compute/v2.1/servers/e848196a-c1b4-4e17-a748-aa877bce4650" status: 200 len: 1314 microversion: 2.1 time: 0.709362 Mar 05 02:52:37.050881 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 28/56] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:52:36 2022] GET /compute/v2.1/servers/e848196a-c1b4-4e17-a748-aa877bce4650 => generated 1314 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 02:52:37.378710 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-4ba689e7-0b99-4491-a082-8ff9f9b181c2 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90033e5e8e634b699bf050e36519f8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8112a5759c444c1f94be24ab61bf072f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:52:37.390752 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-4ba689e7-0b99-4491-a082-8ff9f9b181c2 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] 10.222.0.26 "GET /compute/v2.1/servers/39e14280-8730-41d3-993e-a158f0029386" status: 200 len: 1322 microversion: 2.1 time: 0.527858 Mar 05 02:52:37.391728 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 29/57] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:52:36 2022] GET /compute/v2.1/servers/39e14280-8730-41d3-993e-a158f0029386 => generated 1322 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 02:52:37.543341 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [req-b88dbd0f-15c7-4390-a057-8794c3c04302 req-84f1a41e-02d8-4a69-b474-e2f65421fafe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e28e570d-3d50-4fe8-bb4a-fe0e95c20fb7", "tag": "f280dd1a-3e15-49a1-9569-b6b40278e2a2"}]} {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 02:52:37.565195 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-2e241cd9-d8fa-4c30-a88a-fc6d29d9f7e7 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:52:37.566415 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-2e241cd9-d8fa-4c30-a88a-fc6d29d9f7e7 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] [instance: e28e570d-3d50-4fe8-bb4a-fe0e95c20fb7] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:52:37.576901 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [req-b88dbd0f-15c7-4390-a057-8794c3c04302 req-84f1a41e-02d8-4a69-b474-e2f65421fafe service nova] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:52:37.579744 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [req-b88dbd0f-15c7-4390-a057-8794c3c04302 req-84f1a41e-02d8-4a69-b474-e2f65421fafe service nova] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:52:37.580217 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-2e241cd9-d8fa-4c30-a88a-fc6d29d9f7e7 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:52:37.582592 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-2e241cd9-d8fa-4c30-a88a-fc6d29d9f7e7 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:52:37.583463 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-2e241cd9-d8fa-4c30-a88a-fc6d29d9f7e7 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:52:37.585583 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-2e241cd9-d8fa-4c30-a88a-fc6d29d9f7e7 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:52:37.618893 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.compute.server_external_events [req-b88dbd0f-15c7-4390-a057-8794c3c04302 req-84f1a41e-02d8-4a69-b474-e2f65421fafe service nova] Creating event network-changed:f280dd1a-3e15-49a1-9569-b6b40278e2a2 for instance e28e570d-3d50-4fe8-bb4a-fe0e95c20fb7 on hv-cinder-82725 Mar 05 02:52:37.623975 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [req-b88dbd0f-15c7-4390-a057-8794c3c04302 req-84f1a41e-02d8-4a69-b474-e2f65421fafe service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088835 Mar 05 02:52:37.624941 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 29/58] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Mar 5 02:52:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 02:52:37.775573 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [req-819b3ab0-fc24-4d30-8e7f-ab8e30352f5b req-8c09ce96-11a3-4992-9d98-1435f0d16840 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "39e14280-8730-41d3-993e-a158f0029386", "tag": "8647369d-1b5f-487f-be9a-cd16b07bda62"}]} {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 02:52:37.810970 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [req-819b3ab0-fc24-4d30-8e7f-ab8e30352f5b req-8c09ce96-11a3-4992-9d98-1435f0d16840 service nova] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:52:37.812976 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [req-819b3ab0-fc24-4d30-8e7f-ab8e30352f5b req-8c09ce96-11a3-4992-9d98-1435f0d16840 service nova] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:52:37.838927 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.compute.server_external_events [req-819b3ab0-fc24-4d30-8e7f-ab8e30352f5b req-8c09ce96-11a3-4992-9d98-1435f0d16840 service nova] Creating event network-changed:8647369d-1b5f-487f-be9a-cd16b07bda62 for instance 39e14280-8730-41d3-993e-a158f0029386 on hv-cinder-82725 Mar 05 02:52:37.845179 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [req-819b3ab0-fc24-4d30-8e7f-ab8e30352f5b req-8c09ce96-11a3-4992-9d98-1435f0d16840 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.218544 Mar 05 02:52:37.846454 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 30/59] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Mar 5 02:52:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 02:52:37.887869 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-ac2695c0-e355-4de1-a4de-853b734a757d tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:52:37.888920 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-ac2695c0-e355-4de1-a4de-853b734a757d tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] [instance: d0080e4b-6532-4e0c-8d19-cfbdf32e401b] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:52:37.907813 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-ac2695c0-e355-4de1-a4de-853b734a757d tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:52:37.908522 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-ac2695c0-e355-4de1-a4de-853b734a757d tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:52:37.909459 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-ac2695c0-e355-4de1-a4de-853b734a757d tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:52:37.910198 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-ac2695c0-e355-4de1-a4de-853b734a757d tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:52:38.067430 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-ac2695c0-e355-4de1-a4de-853b734a757d tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e5a000087fe40419ccd0d1a96fb4783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9d27da2e71d4962a53a95efc46518ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:52:38.076195 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-ac2695c0-e355-4de1-a4de-853b734a757d tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] 10.222.0.26 "GET /compute/v2.1/servers/d0080e4b-6532-4e0c-8d19-cfbdf32e401b" status: 200 len: 1295 microversion: 2.1 time: 0.200608 Mar 05 02:52:38.077384 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 31/60] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:52:37 2022] GET /compute/v2.1/servers/d0080e4b-6532-4e0c-8d19-cfbdf32e401b => generated 1295 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 02:52:38.083779 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-731ac0fc-700b-44d2-ad5c-569e730bc930 tempest-DeleteServersTestJSON-1135736220 tempest-DeleteServersTestJSON-1135736220-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:52:38.084650 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-731ac0fc-700b-44d2-ad5c-569e730bc930 tempest-DeleteServersTestJSON-1135736220 tempest-DeleteServersTestJSON-1135736220-project] [instance: e848196a-c1b4-4e17-a748-aa877bce4650] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:52:38.091636 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-731ac0fc-700b-44d2-ad5c-569e730bc930 tempest-DeleteServersTestJSON-1135736220 tempest-DeleteServersTestJSON-1135736220-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:52:38.092101 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-731ac0fc-700b-44d2-ad5c-569e730bc930 tempest-DeleteServersTestJSON-1135736220 tempest-DeleteServersTestJSON-1135736220-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:52:38.092942 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-731ac0fc-700b-44d2-ad5c-569e730bc930 tempest-DeleteServersTestJSON-1135736220 tempest-DeleteServersTestJSON-1135736220-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:52:38.093390 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-731ac0fc-700b-44d2-ad5c-569e730bc930 tempest-DeleteServersTestJSON-1135736220 tempest-DeleteServersTestJSON-1135736220-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:52:38.267818 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-2e241cd9-d8fa-4c30-a88a-fc6d29d9f7e7 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:52:38.281331 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-2e241cd9-d8fa-4c30-a88a-fc6d29d9f7e7 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:52:38.286368 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-2e241cd9-d8fa-4c30-a88a-fc6d29d9f7e7 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:52:38.287574 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-2e241cd9-d8fa-4c30-a88a-fc6d29d9f7e7 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] 10.222.0.26 "GET /compute/v2.1/servers/e28e570d-3d50-4fe8-bb4a-fe0e95c20fb7" status: 200 len: 1407 microversion: 2.20 time: 0.729422 Mar 05 02:52:38.303336 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 30/61] 10.222.0.26 () {60 vars in 1276 bytes} [Sat Mar 5 02:52:37 2022] GET /compute/v2.1/servers/e28e570d-3d50-4fe8-bb4a-fe0e95c20fb7 => generated 1407 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 05 02:52:38.409760 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-2acb1f30-f6b2-4051-bf23-946ac3173ffe tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:52:38.410410 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-2acb1f30-f6b2-4051-bf23-946ac3173ffe tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] [instance: 39e14280-8730-41d3-993e-a158f0029386] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:52:38.419798 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-2acb1f30-f6b2-4051-bf23-946ac3173ffe tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:52:38.420251 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-2acb1f30-f6b2-4051-bf23-946ac3173ffe tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:52:38.421027 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-2acb1f30-f6b2-4051-bf23-946ac3173ffe tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:52:38.421464 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-2acb1f30-f6b2-4051-bf23-946ac3173ffe tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:52:38.568924 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-731ac0fc-700b-44d2-ad5c-569e730bc930 tempest-DeleteServersTestJSON-1135736220 tempest-DeleteServersTestJSON-1135736220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22f302bdee4e47e79b975e5c0b88ff29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b241a841129430e93d2a9d0da408b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:52:38.583068 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-731ac0fc-700b-44d2-ad5c-569e730bc930 tempest-DeleteServersTestJSON-1135736220 tempest-DeleteServersTestJSON-1135736220-project] 10.222.0.26 "GET /compute/v2.1/servers/e848196a-c1b4-4e17-a748-aa877bce4650" status: 200 len: 1501 microversion: 2.1 time: 0.504046 Mar 05 02:52:38.584089 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 32/62] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:52:38 2022] GET /compute/v2.1/servers/e848196a-c1b4-4e17-a748-aa877bce4650 => generated 1501 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 02:52:39.095876 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-1f8fa317-cc17-452a-801b-24dbc0630c01 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:52:39.102873 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-1f8fa317-cc17-452a-801b-24dbc0630c01 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] [instance: d0080e4b-6532-4e0c-8d19-cfbdf32e401b] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:52:39.129663 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-1f8fa317-cc17-452a-801b-24dbc0630c01 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:52:39.132530 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-1f8fa317-cc17-452a-801b-24dbc0630c01 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:52:39.133385 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-1f8fa317-cc17-452a-801b-24dbc0630c01 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:52:39.133820 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-1f8fa317-cc17-452a-801b-24dbc0630c01 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:52:39.211204 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-2acb1f30-f6b2-4051-bf23-946ac3173ffe tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90033e5e8e634b699bf050e36519f8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8112a5759c444c1f94be24ab61bf072f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:52:39.220517 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-2acb1f30-f6b2-4051-bf23-946ac3173ffe tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] 10.222.0.26 "GET /compute/v2.1/servers/39e14280-8730-41d3-993e-a158f0029386" status: 200 len: 1322 microversion: 2.1 time: 0.816305 Mar 05 02:52:39.224665 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 31/63] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:52:38 2022] GET /compute/v2.1/servers/39e14280-8730-41d3-993e-a158f0029386 => generated 1322 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 02:52:39.309124 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-9b1f6ecb-b085-4804-8e96-3917a85a657a tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:52:39.310188 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-9b1f6ecb-b085-4804-8e96-3917a85a657a tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] [instance: e28e570d-3d50-4fe8-bb4a-fe0e95c20fb7] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:52:39.316840 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-9b1f6ecb-b085-4804-8e96-3917a85a657a tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:52:39.317550 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-9b1f6ecb-b085-4804-8e96-3917a85a657a tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:52:39.318552 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-9b1f6ecb-b085-4804-8e96-3917a85a657a tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:52:39.319213 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-9b1f6ecb-b085-4804-8e96-3917a85a657a tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:52:39.778974 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-1f8fa317-cc17-452a-801b-24dbc0630c01 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e5a000087fe40419ccd0d1a96fb4783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9d27da2e71d4962a53a95efc46518ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:52:39.788932 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-1f8fa317-cc17-452a-801b-24dbc0630c01 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] 10.222.0.26 "GET /compute/v2.1/servers/d0080e4b-6532-4e0c-8d19-cfbdf32e401b" status: 200 len: 1363 microversion: 2.1 time: 0.697413 Mar 05 02:52:39.789533 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 33/64] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:52:39 2022] GET /compute/v2.1/servers/d0080e4b-6532-4e0c-8d19-cfbdf32e401b => generated 1363 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 02:52:39.794581 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [req-8f04f153-5c85-4026-914a-d92d229c4c0f req-bb71b85d-ba51-4300-a242-b37d476f87ce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c24fee69-5bf4-40f4-ba18-56aecd12dd96", "tag": "97ec8c13-e022-49e6-a358-8a738e1e166c"}]} {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 02:52:39.803271 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [req-8f04f153-5c85-4026-914a-d92d229c4c0f req-bb71b85d-ba51-4300-a242-b37d476f87ce service nova] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:52:39.804727 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [req-8f04f153-5c85-4026-914a-d92d229c4c0f req-bb71b85d-ba51-4300-a242-b37d476f87ce service nova] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:52:39.817436 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-9b1f6ecb-b085-4804-8e96-3917a85a657a tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:52:39.828055 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-9b1f6ecb-b085-4804-8e96-3917a85a657a tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:52:39.830704 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.compute.server_external_events [req-8f04f153-5c85-4026-914a-d92d229c4c0f req-bb71b85d-ba51-4300-a242-b37d476f87ce service nova] Creating event network-changed:97ec8c13-e022-49e6-a358-8a738e1e166c for instance c24fee69-5bf4-40f4-ba18-56aecd12dd96 on hv-cinder-82725 Mar 05 02:52:39.833032 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-9b1f6ecb-b085-4804-8e96-3917a85a657a tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:52:39.834480 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-9b1f6ecb-b085-4804-8e96-3917a85a657a tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] 10.222.0.26 "GET /compute/v2.1/servers/e28e570d-3d50-4fe8-bb4a-fe0e95c20fb7" status: 200 len: 1407 microversion: 2.20 time: 0.529209 Mar 05 02:52:39.849060 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 32/65] 10.222.0.26 () {60 vars in 1276 bytes} [Sat Mar 5 02:52:39 2022] GET /compute/v2.1/servers/e28e570d-3d50-4fe8-bb4a-fe0e95c20fb7 => generated 1407 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 02:52:39.849561 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [req-8f04f153-5c85-4026-914a-d92d229c4c0f req-bb71b85d-ba51-4300-a242-b37d476f87ce service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049537 Mar 05 02:52:39.849561 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 34/66] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Mar 5 02:52:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 02:52:40.239697 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-5fee7763-b81d-4020-a6fa-2ef238803786 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:52:40.240934 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-5fee7763-b81d-4020-a6fa-2ef238803786 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] [instance: 39e14280-8730-41d3-993e-a158f0029386] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:52:40.262598 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-5fee7763-b81d-4020-a6fa-2ef238803786 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:52:40.262977 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-5fee7763-b81d-4020-a6fa-2ef238803786 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:52:40.263756 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-5fee7763-b81d-4020-a6fa-2ef238803786 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:52:40.264211 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-5fee7763-b81d-4020-a6fa-2ef238803786 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:52:40.374979 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-092f7a9f-b41c-44df-8223-4a9ba77597fb tempest-DeleteServersTestJSON-1135736220 tempest-DeleteServersTestJSON-1135736220-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "873c3d3c-53ea-4914-a1b1-8444bcd5b8fe"}} {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 02:52:40.376718 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-092f7a9f-b41c-44df-8223-4a9ba77597fb tempest-DeleteServersTestJSON-1135736220 tempest-DeleteServersTestJSON-1135736220-project] [instance: e848196a-c1b4-4e17-a748-aa877bce4650] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:52:40.397841 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-092f7a9f-b41c-44df-8223-4a9ba77597fb tempest-DeleteServersTestJSON-1135736220 tempest-DeleteServersTestJSON-1135736220-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:52:40.398327 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-092f7a9f-b41c-44df-8223-4a9ba77597fb tempest-DeleteServersTestJSON-1135736220 tempest-DeleteServersTestJSON-1135736220-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:52:40.399120 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-092f7a9f-b41c-44df-8223-4a9ba77597fb tempest-DeleteServersTestJSON-1135736220 tempest-DeleteServersTestJSON-1135736220-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:52:40.399561 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-092f7a9f-b41c-44df-8223-4a9ba77597fb tempest-DeleteServersTestJSON-1135736220 tempest-DeleteServersTestJSON-1135736220-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:52:40.995020 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-092f7a9f-b41c-44df-8223-4a9ba77597fb tempest-DeleteServersTestJSON-1135736220 tempest-DeleteServersTestJSON-1135736220-project] 10.222.0.26 "POST /compute/v2.1/servers/e848196a-c1b4-4e17-a748-aa877bce4650/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.624149 Mar 05 02:52:40.997333 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 35/67] 10.222.0.26 () {60 vars in 1322 bytes} [Sat Mar 5 02:52:40 2022] POST /compute/v2.1/servers/e848196a-c1b4-4e17-a748-aa877bce4650/os-volume_attachments => generated 194 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 02:52:41.013485 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [req-571e43e3-955a-42a0-bf87-e482139d0d34 req-dea56162-6d9d-42a8-91da-6659b7731366 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d0080e4b-6532-4e0c-8d19-cfbdf32e401b", "tag": "f5a9d7d0-d2b2-401b-bf1a-016e681e13ff"}]} {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 02:52:41.034864 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [req-571e43e3-955a-42a0-bf87-e482139d0d34 req-dea56162-6d9d-42a8-91da-6659b7731366 service nova] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:52:41.035670 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [req-571e43e3-955a-42a0-bf87-e482139d0d34 req-dea56162-6d9d-42a8-91da-6659b7731366 service nova] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:52:41.053614 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.compute.server_external_events [req-571e43e3-955a-42a0-bf87-e482139d0d34 req-dea56162-6d9d-42a8-91da-6659b7731366 service nova] Creating event network-changed:f5a9d7d0-d2b2-401b-bf1a-016e681e13ff for instance d0080e4b-6532-4e0c-8d19-cfbdf32e401b on hv-cinder-82725 Mar 05 02:52:41.066545 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [req-571e43e3-955a-42a0-bf87-e482139d0d34 req-dea56162-6d9d-42a8-91da-6659b7731366 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067549 Mar 05 02:52:41.073554 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 36/68] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Mar 5 02:52:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 02:52:41.080021 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-9d86940d-df74-4d01-b30d-6bb828e8638c tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:52:41.080959 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-9d86940d-df74-4d01-b30d-6bb828e8638c tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] [instance: d0080e4b-6532-4e0c-8d19-cfbdf32e401b] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:52:41.088661 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-9d86940d-df74-4d01-b30d-6bb828e8638c tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:52:41.089365 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-9d86940d-df74-4d01-b30d-6bb828e8638c tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:52:41.090398 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-9d86940d-df74-4d01-b30d-6bb828e8638c tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:52:41.091224 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-9d86940d-df74-4d01-b30d-6bb828e8638c tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:52:41.143796 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-5fee7763-b81d-4020-a6fa-2ef238803786 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90033e5e8e634b699bf050e36519f8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8112a5759c444c1f94be24ab61bf072f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:52:41.159393 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-5fee7763-b81d-4020-a6fa-2ef238803786 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] 10.222.0.26 "GET /compute/v2.1/servers/39e14280-8730-41d3-993e-a158f0029386" status: 200 len: 1322 microversion: 2.1 time: 0.926358 Mar 05 02:52:41.169509 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 33/69] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:52:40 2022] GET /compute/v2.1/servers/39e14280-8730-41d3-993e-a158f0029386 => generated 1322 bytes in 937 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 02:52:41.175589 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-5733bd86-04a6-48b0-a94c-e56ea37aa172 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:52:41.180194 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-5733bd86-04a6-48b0-a94c-e56ea37aa172 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] [instance: e28e570d-3d50-4fe8-bb4a-fe0e95c20fb7] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:52:41.193167 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-5733bd86-04a6-48b0-a94c-e56ea37aa172 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:52:41.194052 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-5733bd86-04a6-48b0-a94c-e56ea37aa172 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:52:41.207028 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-5733bd86-04a6-48b0-a94c-e56ea37aa172 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:52:41.207575 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-5733bd86-04a6-48b0-a94c-e56ea37aa172 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:52:41.472574 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-9d86940d-df74-4d01-b30d-6bb828e8638c tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e5a000087fe40419ccd0d1a96fb4783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9d27da2e71d4962a53a95efc46518ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:52:41.480119 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-9d86940d-df74-4d01-b30d-6bb828e8638c tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] 10.222.0.26 "GET /compute/v2.1/servers/d0080e4b-6532-4e0c-8d19-cfbdf32e401b" status: 200 len: 1363 microversion: 2.1 time: 0.404629 Mar 05 02:52:41.481391 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 37/70] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:52:41 2022] GET /compute/v2.1/servers/d0080e4b-6532-4e0c-8d19-cfbdf32e401b => generated 1363 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 02:52:41.600729 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-5733bd86-04a6-48b0-a94c-e56ea37aa172 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:52:41.609241 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-5733bd86-04a6-48b0-a94c-e56ea37aa172 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:52:41.632108 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-5733bd86-04a6-48b0-a94c-e56ea37aa172 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:52:41.633483 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-5733bd86-04a6-48b0-a94c-e56ea37aa172 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] 10.222.0.26 "GET /compute/v2.1/servers/e28e570d-3d50-4fe8-bb4a-fe0e95c20fb7" status: 200 len: 1407 microversion: 2.20 time: 0.462435 Mar 05 02:52:41.634434 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 34/71] 10.222.0.26 () {60 vars in 1276 bytes} [Sat Mar 5 02:52:41 2022] GET /compute/v2.1/servers/e28e570d-3d50-4fe8-bb4a-fe0e95c20fb7 => generated 1407 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 02:52:42.177762 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-dafe6be0-d369-47ef-8b34-ad19f23d37d5 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:52:42.178862 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-dafe6be0-d369-47ef-8b34-ad19f23d37d5 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] [instance: 39e14280-8730-41d3-993e-a158f0029386] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:52:42.193539 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-dafe6be0-d369-47ef-8b34-ad19f23d37d5 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:52:42.196524 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-dafe6be0-d369-47ef-8b34-ad19f23d37d5 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:52:42.197423 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-dafe6be0-d369-47ef-8b34-ad19f23d37d5 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:52:42.200562 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-dafe6be0-d369-47ef-8b34-ad19f23d37d5 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:52:42.497542 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-619c5021-387e-4daa-a223-e013b5243ad4 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:52:42.503774 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-619c5021-387e-4daa-a223-e013b5243ad4 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] [instance: d0080e4b-6532-4e0c-8d19-cfbdf32e401b] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:52:42.518585 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-619c5021-387e-4daa-a223-e013b5243ad4 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:52:42.519090 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-619c5021-387e-4daa-a223-e013b5243ad4 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:52:42.519930 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-619c5021-387e-4daa-a223-e013b5243ad4 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:52:42.520448 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-619c5021-387e-4daa-a223-e013b5243ad4 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:52:42.833213 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-dafe6be0-d369-47ef-8b34-ad19f23d37d5 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90033e5e8e634b699bf050e36519f8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8112a5759c444c1f94be24ab61bf072f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:52:42.842731 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-dafe6be0-d369-47ef-8b34-ad19f23d37d5 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] 10.222.0.26 "GET /compute/v2.1/servers/39e14280-8730-41d3-993e-a158f0029386" status: 200 len: 1322 microversion: 2.1 time: 0.667706 Mar 05 02:52:42.842731 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 38/72] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:52:42 2022] GET /compute/v2.1/servers/39e14280-8730-41d3-993e-a158f0029386 => generated 1322 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 02:52:42.849558 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-e2712962-ccbd-410f-a354-a935ffb5ada6 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:52:42.850255 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-e2712962-ccbd-410f-a354-a935ffb5ada6 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] [instance: e28e570d-3d50-4fe8-bb4a-fe0e95c20fb7] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:52:42.866653 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-e2712962-ccbd-410f-a354-a935ffb5ada6 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:52:42.870195 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-e2712962-ccbd-410f-a354-a935ffb5ada6 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:52:42.871118 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-e2712962-ccbd-410f-a354-a935ffb5ada6 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:52:42.871475 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-e2712962-ccbd-410f-a354-a935ffb5ada6 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:52:42.883814 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-619c5021-387e-4daa-a223-e013b5243ad4 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e5a000087fe40419ccd0d1a96fb4783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9d27da2e71d4962a53a95efc46518ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:52:42.895817 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-619c5021-387e-4daa-a223-e013b5243ad4 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] 10.222.0.26 "GET /compute/v2.1/servers/d0080e4b-6532-4e0c-8d19-cfbdf32e401b" status: 200 len: 1363 microversion: 2.1 time: 0.401979 Mar 05 02:52:42.905256 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 35/73] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:52:42 2022] GET /compute/v2.1/servers/d0080e4b-6532-4e0c-8d19-cfbdf32e401b => generated 1363 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 02:52:43.063700 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-e2712962-ccbd-410f-a354-a935ffb5ada6 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:52:43.073473 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-e2712962-ccbd-410f-a354-a935ffb5ada6 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:52:43.079313 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-e2712962-ccbd-410f-a354-a935ffb5ada6 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:52:43.080426 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-e2712962-ccbd-410f-a354-a935ffb5ada6 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] 10.222.0.26 "GET /compute/v2.1/servers/e28e570d-3d50-4fe8-bb4a-fe0e95c20fb7" status: 200 len: 1407 microversion: 2.20 time: 0.234793 Mar 05 02:52:43.080996 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 39/74] 10.222.0.26 () {60 vars in 1276 bytes} [Sat Mar 5 02:52:42 2022] GET /compute/v2.1/servers/e28e570d-3d50-4fe8-bb4a-fe0e95c20fb7 => generated 1407 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 02:52:43.858657 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-5a5aaab6-f85b-41b7-b61c-80b5e032473c tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:52:43.859271 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-5a5aaab6-f85b-41b7-b61c-80b5e032473c tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] [instance: 39e14280-8730-41d3-993e-a158f0029386] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:52:43.866328 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-5a5aaab6-f85b-41b7-b61c-80b5e032473c tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:52:43.866778 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-5a5aaab6-f85b-41b7-b61c-80b5e032473c tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:52:43.867543 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-5a5aaab6-f85b-41b7-b61c-80b5e032473c tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:52:43.867974 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-5a5aaab6-f85b-41b7-b61c-80b5e032473c tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:52:43.919712 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-47c4c8f6-c5dd-4dda-9f67-a4b1cc80a618 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:52:43.920329 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-47c4c8f6-c5dd-4dda-9f67-a4b1cc80a618 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] [instance: d0080e4b-6532-4e0c-8d19-cfbdf32e401b] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:52:43.930274 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-47c4c8f6-c5dd-4dda-9f67-a4b1cc80a618 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:52:43.930925 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-47c4c8f6-c5dd-4dda-9f67-a4b1cc80a618 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:52:43.931856 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-47c4c8f6-c5dd-4dda-9f67-a4b1cc80a618 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:52:43.932431 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-47c4c8f6-c5dd-4dda-9f67-a4b1cc80a618 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:52:44.045405 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-5a5aaab6-f85b-41b7-b61c-80b5e032473c tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90033e5e8e634b699bf050e36519f8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8112a5759c444c1f94be24ab61bf072f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:52:44.053942 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-5a5aaab6-f85b-41b7-b61c-80b5e032473c tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] 10.222.0.26 "GET /compute/v2.1/servers/39e14280-8730-41d3-993e-a158f0029386" status: 200 len: 1322 microversion: 2.1 time: 0.200253 Mar 05 02:52:44.054813 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 36/75] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:52:43 2022] GET /compute/v2.1/servers/39e14280-8730-41d3-993e-a158f0029386 => generated 1322 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 02:52:44.099424 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-b72f7503-1c30-41a2-a7fe-4be14cc8f485 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:52:44.100107 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-b72f7503-1c30-41a2-a7fe-4be14cc8f485 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] [instance: e28e570d-3d50-4fe8-bb4a-fe0e95c20fb7] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:52:44.106511 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-b72f7503-1c30-41a2-a7fe-4be14cc8f485 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:52:44.106973 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-b72f7503-1c30-41a2-a7fe-4be14cc8f485 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:52:44.107778 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-b72f7503-1c30-41a2-a7fe-4be14cc8f485 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:52:44.108217 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-b72f7503-1c30-41a2-a7fe-4be14cc8f485 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:52:44.108961 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-47c4c8f6-c5dd-4dda-9f67-a4b1cc80a618 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e5a000087fe40419ccd0d1a96fb4783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9d27da2e71d4962a53a95efc46518ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:52:44.117471 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-47c4c8f6-c5dd-4dda-9f67-a4b1cc80a618 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] 10.222.0.26 "GET /compute/v2.1/servers/d0080e4b-6532-4e0c-8d19-cfbdf32e401b" status: 200 len: 1363 microversion: 2.1 time: 0.205965 Mar 05 02:52:44.118180 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 40/76] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:52:43 2022] GET /compute/v2.1/servers/d0080e4b-6532-4e0c-8d19-cfbdf32e401b => generated 1363 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 02:52:44.250973 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-b72f7503-1c30-41a2-a7fe-4be14cc8f485 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:52:44.259590 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-b72f7503-1c30-41a2-a7fe-4be14cc8f485 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:52:44.261232 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-b72f7503-1c30-41a2-a7fe-4be14cc8f485 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:52:44.262381 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-b72f7503-1c30-41a2-a7fe-4be14cc8f485 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] 10.222.0.26 "GET /compute/v2.1/servers/e28e570d-3d50-4fe8-bb4a-fe0e95c20fb7" status: 200 len: 1407 microversion: 2.20 time: 0.167120 Mar 05 02:52:44.263023 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 37/77] 10.222.0.26 () {60 vars in 1276 bytes} [Sat Mar 5 02:52:44 2022] GET /compute/v2.1/servers/e28e570d-3d50-4fe8-bb4a-fe0e95c20fb7 => generated 1407 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 05 02:52:45.074961 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-2f617f8f-e60e-402e-b1f9-e67c9dcec7e8 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:52:45.075592 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-2f617f8f-e60e-402e-b1f9-e67c9dcec7e8 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] [instance: 39e14280-8730-41d3-993e-a158f0029386] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:52:45.082536 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-2f617f8f-e60e-402e-b1f9-e67c9dcec7e8 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:52:45.082988 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-2f617f8f-e60e-402e-b1f9-e67c9dcec7e8 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:52:45.083750 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-2f617f8f-e60e-402e-b1f9-e67c9dcec7e8 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:52:45.084181 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-2f617f8f-e60e-402e-b1f9-e67c9dcec7e8 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:52:45.134765 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-7f26cd98-8306-4b32-9d00-e88089c3542a tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:52:45.135295 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-7f26cd98-8306-4b32-9d00-e88089c3542a tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] [instance: d0080e4b-6532-4e0c-8d19-cfbdf32e401b] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:52:45.142477 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-7f26cd98-8306-4b32-9d00-e88089c3542a tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:52:45.143003 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-7f26cd98-8306-4b32-9d00-e88089c3542a tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:52:45.143854 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-7f26cd98-8306-4b32-9d00-e88089c3542a tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:52:45.144363 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-7f26cd98-8306-4b32-9d00-e88089c3542a tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:52:45.259023 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-2f617f8f-e60e-402e-b1f9-e67c9dcec7e8 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90033e5e8e634b699bf050e36519f8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8112a5759c444c1f94be24ab61bf072f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:52:45.267431 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-2f617f8f-e60e-402e-b1f9-e67c9dcec7e8 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] 10.222.0.26 "GET /compute/v2.1/servers/39e14280-8730-41d3-993e-a158f0029386" status: 200 len: 1322 microversion: 2.1 time: 0.196248 Mar 05 02:52:45.268078 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 41/78] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:52:45 2022] GET /compute/v2.1/servers/39e14280-8730-41d3-993e-a158f0029386 => generated 1322 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 02:52:45.281996 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-33076149-a533-42ab-9806-cb50e92b2524 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:52:45.282671 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-33076149-a533-42ab-9806-cb50e92b2524 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] [instance: e28e570d-3d50-4fe8-bb4a-fe0e95c20fb7] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:52:45.289022 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-33076149-a533-42ab-9806-cb50e92b2524 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:52:45.289892 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-33076149-a533-42ab-9806-cb50e92b2524 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:52:45.290745 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-33076149-a533-42ab-9806-cb50e92b2524 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:52:45.291219 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-33076149-a533-42ab-9806-cb50e92b2524 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:52:45.318316 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-7f26cd98-8306-4b32-9d00-e88089c3542a tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e5a000087fe40419ccd0d1a96fb4783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9d27da2e71d4962a53a95efc46518ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:52:45.329052 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-7f26cd98-8306-4b32-9d00-e88089c3542a tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] 10.222.0.26 "GET /compute/v2.1/servers/d0080e4b-6532-4e0c-8d19-cfbdf32e401b" status: 200 len: 1363 microversion: 2.1 time: 0.197189 Mar 05 02:52:45.329698 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 38/79] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:52:45 2022] GET /compute/v2.1/servers/d0080e4b-6532-4e0c-8d19-cfbdf32e401b => generated 1363 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 02:52:45.431797 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-33076149-a533-42ab-9806-cb50e92b2524 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:52:45.440596 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-33076149-a533-42ab-9806-cb50e92b2524 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:52:45.442121 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-33076149-a533-42ab-9806-cb50e92b2524 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:52:45.443238 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-33076149-a533-42ab-9806-cb50e92b2524 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] 10.222.0.26 "GET /compute/v2.1/servers/e28e570d-3d50-4fe8-bb4a-fe0e95c20fb7" status: 200 len: 1407 microversion: 2.20 time: 0.165555 Mar 05 02:52:45.443809 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 42/80] 10.222.0.26 () {60 vars in 1276 bytes} [Sat Mar 5 02:52:45 2022] GET /compute/v2.1/servers/e28e570d-3d50-4fe8-bb4a-fe0e95c20fb7 => generated 1407 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 02:52:46.284787 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-776f5050-a746-4dab-8308-a35a6236f405 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:52:46.285646 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-776f5050-a746-4dab-8308-a35a6236f405 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] [instance: 39e14280-8730-41d3-993e-a158f0029386] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:52:46.292281 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-776f5050-a746-4dab-8308-a35a6236f405 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:52:46.293181 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-776f5050-a746-4dab-8308-a35a6236f405 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:52:46.293522 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-776f5050-a746-4dab-8308-a35a6236f405 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:52:46.293980 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-776f5050-a746-4dab-8308-a35a6236f405 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:52:46.347442 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-4b94cca3-8303-4f65-a7a2-cb15318752a1 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:52:46.348652 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-4b94cca3-8303-4f65-a7a2-cb15318752a1 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] [instance: d0080e4b-6532-4e0c-8d19-cfbdf32e401b] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:52:46.356279 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-4b94cca3-8303-4f65-a7a2-cb15318752a1 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:52:46.356733 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-4b94cca3-8303-4f65-a7a2-cb15318752a1 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:52:46.357795 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-4b94cca3-8303-4f65-a7a2-cb15318752a1 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:52:46.358428 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-4b94cca3-8303-4f65-a7a2-cb15318752a1 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:52:46.477905 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-776f5050-a746-4dab-8308-a35a6236f405 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90033e5e8e634b699bf050e36519f8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8112a5759c444c1f94be24ab61bf072f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:52:46.486310 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-776f5050-a746-4dab-8308-a35a6236f405 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] 10.222.0.26 "GET /compute/v2.1/servers/39e14280-8730-41d3-993e-a158f0029386" status: 200 len: 1322 microversion: 2.1 time: 0.206156 Mar 05 02:52:46.486884 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 39/81] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:52:46 2022] GET /compute/v2.1/servers/39e14280-8730-41d3-993e-a158f0029386 => generated 1322 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 02:52:46.492972 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-d3dc4a2e-8d11-4dfb-8dd9-561628603c80 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:52:46.493809 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-d3dc4a2e-8d11-4dfb-8dd9-561628603c80 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] [instance: e28e570d-3d50-4fe8-bb4a-fe0e95c20fb7] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:52:46.500881 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-d3dc4a2e-8d11-4dfb-8dd9-561628603c80 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:52:46.501466 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-d3dc4a2e-8d11-4dfb-8dd9-561628603c80 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:52:46.502389 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-d3dc4a2e-8d11-4dfb-8dd9-561628603c80 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:52:46.502832 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-d3dc4a2e-8d11-4dfb-8dd9-561628603c80 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:52:46.565131 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-4b94cca3-8303-4f65-a7a2-cb15318752a1 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e5a000087fe40419ccd0d1a96fb4783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9d27da2e71d4962a53a95efc46518ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:52:46.573087 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-4b94cca3-8303-4f65-a7a2-cb15318752a1 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] 10.222.0.26 "GET /compute/v2.1/servers/d0080e4b-6532-4e0c-8d19-cfbdf32e401b" status: 200 len: 1363 microversion: 2.1 time: 0.230742 Mar 05 02:52:46.578028 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 43/82] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:52:46 2022] GET /compute/v2.1/servers/d0080e4b-6532-4e0c-8d19-cfbdf32e401b => generated 1363 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 02:52:46.674795 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-d3dc4a2e-8d11-4dfb-8dd9-561628603c80 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:52:46.682910 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-d3dc4a2e-8d11-4dfb-8dd9-561628603c80 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:52:46.684412 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-d3dc4a2e-8d11-4dfb-8dd9-561628603c80 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:52:46.685587 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-d3dc4a2e-8d11-4dfb-8dd9-561628603c80 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] 10.222.0.26 "GET /compute/v2.1/servers/e28e570d-3d50-4fe8-bb4a-fe0e95c20fb7" status: 200 len: 1407 microversion: 2.20 time: 0.197598 Mar 05 02:52:46.691178 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 40/83] 10.222.0.26 () {60 vars in 1276 bytes} [Sat Mar 5 02:52:46 2022] GET /compute/v2.1/servers/e28e570d-3d50-4fe8-bb4a-fe0e95c20fb7 => generated 1407 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 02:52:47.502961 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-0250515a-68d3-4a6d-90aa-351f7b7a77c2 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:52:47.503685 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-0250515a-68d3-4a6d-90aa-351f7b7a77c2 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] [instance: 39e14280-8730-41d3-993e-a158f0029386] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:52:47.510658 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-0250515a-68d3-4a6d-90aa-351f7b7a77c2 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:52:47.513722 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-0250515a-68d3-4a6d-90aa-351f7b7a77c2 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:52:47.514665 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-0250515a-68d3-4a6d-90aa-351f7b7a77c2 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:52:47.515262 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-0250515a-68d3-4a6d-90aa-351f7b7a77c2 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:52:47.590962 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-16b84e69-3acc-42ba-9e40-5e810b42f0cd tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:52:47.592842 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-16b84e69-3acc-42ba-9e40-5e810b42f0cd tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] [instance: d0080e4b-6532-4e0c-8d19-cfbdf32e401b] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:52:47.601375 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-16b84e69-3acc-42ba-9e40-5e810b42f0cd tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:52:47.601991 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-16b84e69-3acc-42ba-9e40-5e810b42f0cd tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:52:47.603250 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-16b84e69-3acc-42ba-9e40-5e810b42f0cd tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:52:47.603859 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-16b84e69-3acc-42ba-9e40-5e810b42f0cd tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:52:47.676463 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-0250515a-68d3-4a6d-90aa-351f7b7a77c2 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90033e5e8e634b699bf050e36519f8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8112a5759c444c1f94be24ab61bf072f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:52:47.688223 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-0250515a-68d3-4a6d-90aa-351f7b7a77c2 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] 10.222.0.26 "GET /compute/v2.1/servers/39e14280-8730-41d3-993e-a158f0029386" status: 200 len: 1322 microversion: 2.1 time: 0.188111 Mar 05 02:52:47.691118 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 44/84] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:52:47 2022] GET /compute/v2.1/servers/39e14280-8730-41d3-993e-a158f0029386 => generated 1322 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 02:52:47.708774 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-e09a6543-29d4-48a7-8fda-5b4c4b3adbd8 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:52:47.709838 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-e09a6543-29d4-48a7-8fda-5b4c4b3adbd8 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] [instance: e28e570d-3d50-4fe8-bb4a-fe0e95c20fb7] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:52:47.715955 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-e09a6543-29d4-48a7-8fda-5b4c4b3adbd8 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:52:47.716478 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-e09a6543-29d4-48a7-8fda-5b4c4b3adbd8 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:52:47.717314 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-e09a6543-29d4-48a7-8fda-5b4c4b3adbd8 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:52:47.717843 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-e09a6543-29d4-48a7-8fda-5b4c4b3adbd8 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:52:47.800628 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-16b84e69-3acc-42ba-9e40-5e810b42f0cd tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e5a000087fe40419ccd0d1a96fb4783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9d27da2e71d4962a53a95efc46518ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:52:47.808566 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-16b84e69-3acc-42ba-9e40-5e810b42f0cd tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] 10.222.0.26 "GET /compute/v2.1/servers/d0080e4b-6532-4e0c-8d19-cfbdf32e401b" status: 200 len: 1363 microversion: 2.1 time: 0.221558 Mar 05 02:52:47.809131 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 41/85] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:52:47 2022] GET /compute/v2.1/servers/d0080e4b-6532-4e0c-8d19-cfbdf32e401b => generated 1363 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 02:52:47.904645 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-e09a6543-29d4-48a7-8fda-5b4c4b3adbd8 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:52:47.913008 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-e09a6543-29d4-48a7-8fda-5b4c4b3adbd8 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:52:47.914531 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-e09a6543-29d4-48a7-8fda-5b4c4b3adbd8 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:52:47.915619 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-e09a6543-29d4-48a7-8fda-5b4c4b3adbd8 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] 10.222.0.26 "GET /compute/v2.1/servers/e28e570d-3d50-4fe8-bb4a-fe0e95c20fb7" status: 200 len: 1407 microversion: 2.20 time: 0.210933 Mar 05 02:52:47.916176 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 45/86] 10.222.0.26 () {60 vars in 1276 bytes} [Sat Mar 5 02:52:47 2022] GET /compute/v2.1/servers/e28e570d-3d50-4fe8-bb4a-fe0e95c20fb7 => generated 1407 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 05 02:52:48.707805 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-fae8f991-cd4b-45ad-8e56-ddcb2ca4335b tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:52:48.708482 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-fae8f991-cd4b-45ad-8e56-ddcb2ca4335b tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] [instance: 39e14280-8730-41d3-993e-a158f0029386] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:52:48.714257 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-fae8f991-cd4b-45ad-8e56-ddcb2ca4335b tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:52:48.714711 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-fae8f991-cd4b-45ad-8e56-ddcb2ca4335b tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:52:48.715476 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-fae8f991-cd4b-45ad-8e56-ddcb2ca4335b tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:52:48.716057 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-fae8f991-cd4b-45ad-8e56-ddcb2ca4335b tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:52:48.825998 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-7f766c2b-0021-4e20-bec7-5e3dd08dcb6a tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:52:48.826782 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-7f766c2b-0021-4e20-bec7-5e3dd08dcb6a tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] [instance: d0080e4b-6532-4e0c-8d19-cfbdf32e401b] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:52:48.834962 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-7f766c2b-0021-4e20-bec7-5e3dd08dcb6a tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:52:48.835551 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-7f766c2b-0021-4e20-bec7-5e3dd08dcb6a tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:52:48.836446 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-7f766c2b-0021-4e20-bec7-5e3dd08dcb6a tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:52:48.836960 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-7f766c2b-0021-4e20-bec7-5e3dd08dcb6a tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:52:48.864399 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-fae8f991-cd4b-45ad-8e56-ddcb2ca4335b tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90033e5e8e634b699bf050e36519f8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8112a5759c444c1f94be24ab61bf072f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:52:48.872287 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-fae8f991-cd4b-45ad-8e56-ddcb2ca4335b tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] 10.222.0.26 "GET /compute/v2.1/servers/39e14280-8730-41d3-993e-a158f0029386" status: 200 len: 1322 microversion: 2.1 time: 0.170632 Mar 05 02:52:48.872993 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 42/87] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:52:48 2022] GET /compute/v2.1/servers/39e14280-8730-41d3-993e-a158f0029386 => generated 1322 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 02:52:48.938589 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-4340079e-7612-4d4a-b05f-ca674cd0f027 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:52:48.939196 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-4340079e-7612-4d4a-b05f-ca674cd0f027 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] [instance: e28e570d-3d50-4fe8-bb4a-fe0e95c20fb7] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:52:48.947859 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-4340079e-7612-4d4a-b05f-ca674cd0f027 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:52:48.948511 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-4340079e-7612-4d4a-b05f-ca674cd0f027 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:52:48.949443 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-4340079e-7612-4d4a-b05f-ca674cd0f027 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:52:48.949873 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-4340079e-7612-4d4a-b05f-ca674cd0f027 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:52:48.986571 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-7f766c2b-0021-4e20-bec7-5e3dd08dcb6a tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e5a000087fe40419ccd0d1a96fb4783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9d27da2e71d4962a53a95efc46518ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:52:48.993772 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-7f766c2b-0021-4e20-bec7-5e3dd08dcb6a tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] 10.222.0.26 "GET /compute/v2.1/servers/d0080e4b-6532-4e0c-8d19-cfbdf32e401b" status: 200 len: 1363 microversion: 2.1 time: 0.172331 Mar 05 02:52:48.994315 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 46/88] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:52:48 2022] GET /compute/v2.1/servers/d0080e4b-6532-4e0c-8d19-cfbdf32e401b => generated 1363 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 02:52:49.092706 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-4340079e-7612-4d4a-b05f-ca674cd0f027 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:52:49.102317 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-4340079e-7612-4d4a-b05f-ca674cd0f027 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:52:49.103895 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-4340079e-7612-4d4a-b05f-ca674cd0f027 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:52:49.105436 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-4340079e-7612-4d4a-b05f-ca674cd0f027 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] 10.222.0.26 "GET /compute/v2.1/servers/e28e570d-3d50-4fe8-bb4a-fe0e95c20fb7" status: 200 len: 1407 microversion: 2.20 time: 0.174366 Mar 05 02:52:49.106393 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 43/89] 10.222.0.26 () {60 vars in 1276 bytes} [Sat Mar 5 02:52:48 2022] GET /compute/v2.1/servers/e28e570d-3d50-4fe8-bb4a-fe0e95c20fb7 => generated 1407 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 02:52:49.891296 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-09604ddf-454d-4eb4-b813-eee1a2c021ae tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:52:49.892092 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-09604ddf-454d-4eb4-b813-eee1a2c021ae tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] [instance: 39e14280-8730-41d3-993e-a158f0029386] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:52:49.899015 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-09604ddf-454d-4eb4-b813-eee1a2c021ae tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:52:49.899472 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-09604ddf-454d-4eb4-b813-eee1a2c021ae tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:52:49.900255 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-09604ddf-454d-4eb4-b813-eee1a2c021ae tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:52:49.900690 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-09604ddf-454d-4eb4-b813-eee1a2c021ae tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:52:50.011077 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-2fa36b18-a11f-4c46-8040-dd677b3a6ce8 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:52:50.018738 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-2fa36b18-a11f-4c46-8040-dd677b3a6ce8 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] [instance: d0080e4b-6532-4e0c-8d19-cfbdf32e401b] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:52:50.025710 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-2fa36b18-a11f-4c46-8040-dd677b3a6ce8 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:52:50.026429 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-2fa36b18-a11f-4c46-8040-dd677b3a6ce8 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:52:50.027369 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-2fa36b18-a11f-4c46-8040-dd677b3a6ce8 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:52:50.027804 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-2fa36b18-a11f-4c46-8040-dd677b3a6ce8 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:52:50.085706 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-09604ddf-454d-4eb4-b813-eee1a2c021ae tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90033e5e8e634b699bf050e36519f8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8112a5759c444c1f94be24ab61bf072f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:52:50.098247 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-09604ddf-454d-4eb4-b813-eee1a2c021ae tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] 10.222.0.26 "GET /compute/v2.1/servers/39e14280-8730-41d3-993e-a158f0029386" status: 200 len: 1322 microversion: 2.1 time: 0.212349 Mar 05 02:52:50.098917 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 47/90] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:52:49 2022] GET /compute/v2.1/servers/39e14280-8730-41d3-993e-a158f0029386 => generated 1322 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 02:52:50.128087 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-e42c69a0-8d20-423d-960e-8c0ef233eedd tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:52:50.129087 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-e42c69a0-8d20-423d-960e-8c0ef233eedd tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] [instance: e28e570d-3d50-4fe8-bb4a-fe0e95c20fb7] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:52:50.136834 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-e42c69a0-8d20-423d-960e-8c0ef233eedd tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:52:50.137832 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-e42c69a0-8d20-423d-960e-8c0ef233eedd tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:52:50.139338 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-e42c69a0-8d20-423d-960e-8c0ef233eedd tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:52:50.140137 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-e42c69a0-8d20-423d-960e-8c0ef233eedd tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:52:50.248033 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-2fa36b18-a11f-4c46-8040-dd677b3a6ce8 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e5a000087fe40419ccd0d1a96fb4783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9d27da2e71d4962a53a95efc46518ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:52:50.261132 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-2fa36b18-a11f-4c46-8040-dd677b3a6ce8 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] 10.222.0.26 "GET /compute/v2.1/servers/d0080e4b-6532-4e0c-8d19-cfbdf32e401b" status: 200 len: 1363 microversion: 2.1 time: 0.253376 Mar 05 02:52:50.263583 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 44/91] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:52:50 2022] GET /compute/v2.1/servers/d0080e4b-6532-4e0c-8d19-cfbdf32e401b => generated 1363 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 02:52:50.332955 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-e42c69a0-8d20-423d-960e-8c0ef233eedd tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:52:50.341703 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-e42c69a0-8d20-423d-960e-8c0ef233eedd tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:52:50.343676 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-e42c69a0-8d20-423d-960e-8c0ef233eedd tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:52:50.345124 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-e42c69a0-8d20-423d-960e-8c0ef233eedd tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] 10.222.0.26 "GET /compute/v2.1/servers/e28e570d-3d50-4fe8-bb4a-fe0e95c20fb7" status: 200 len: 1407 microversion: 2.20 time: 0.224168 Mar 05 02:52:50.355792 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 48/92] 10.222.0.26 () {60 vars in 1276 bytes} [Sat Mar 5 02:52:50 2022] GET /compute/v2.1/servers/e28e570d-3d50-4fe8-bb4a-fe0e95c20fb7 => generated 1407 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 05 02:52:50.518806 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [req-920ba2ce-5c5f-4aa6-a6cc-de6b5d766401 req-44a04ab7-0bf7-4355-a048-2dac568f6fdf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e28e570d-3d50-4fe8-bb4a-fe0e95c20fb7", "name": "network-vif-plugged", "status": "completed", "tag": "f280dd1a-3e15-49a1-9569-b6b40278e2a2"}]} {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 02:52:50.529895 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [req-920ba2ce-5c5f-4aa6-a6cc-de6b5d766401 req-44a04ab7-0bf7-4355-a048-2dac568f6fdf service nova] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:52:50.542213 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [req-920ba2ce-5c5f-4aa6-a6cc-de6b5d766401 req-44a04ab7-0bf7-4355-a048-2dac568f6fdf service nova] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:52:50.568072 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.compute.server_external_events [req-920ba2ce-5c5f-4aa6-a6cc-de6b5d766401 req-44a04ab7-0bf7-4355-a048-2dac568f6fdf service nova] Creating event network-vif-plugged:f280dd1a-3e15-49a1-9569-b6b40278e2a2 for instance e28e570d-3d50-4fe8-bb4a-fe0e95c20fb7 on hv-cinder-82725 Mar 05 02:52:50.568615 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [req-920ba2ce-5c5f-4aa6-a6cc-de6b5d766401 req-44a04ab7-0bf7-4355-a048-2dac568f6fdf service nova] Acquired lock "compute-rpcapi-router" {{(pid=123545) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Mar 05 02:52:50.569716 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-d17794d6-0cb4-4714-aa47-99dd2434cbb4 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:52:50.571018 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-d17794d6-0cb4-4714-aa47-99dd2434cbb4 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:52:50.571970 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-d17794d6-0cb4-4714-aa47-99dd2434cbb4 None None] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:52:50.572686 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-d17794d6-0cb4-4714-aa47-99dd2434cbb4 None None] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:52:50.591900 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.compute.rpcapi [None req-d17794d6-0cb4-4714-aa47-99dd2434cbb4 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Mar 05 02:52:50.597229 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-d17794d6-0cb4-4714-aa47-99dd2434cbb4 None None] Releasing lock "compute-rpcapi-router" {{(pid=123545) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Mar 05 02:52:50.618389 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-d17794d6-0cb4-4714-aa47-99dd2434cbb4 None None] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105923 Mar 05 02:52:50.620047 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 45/93] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Mar 5 02:52:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 02:52:51.115233 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-80f5b392-2af4-4cc1-aee2-c6a5abd711a0 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:52:51.116521 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-80f5b392-2af4-4cc1-aee2-c6a5abd711a0 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] [instance: 39e14280-8730-41d3-993e-a158f0029386] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:52:51.122822 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-80f5b392-2af4-4cc1-aee2-c6a5abd711a0 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:52:51.123290 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-80f5b392-2af4-4cc1-aee2-c6a5abd711a0 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:52:51.124077 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-80f5b392-2af4-4cc1-aee2-c6a5abd711a0 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:52:51.124520 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-80f5b392-2af4-4cc1-aee2-c6a5abd711a0 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:52:51.282184 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-9986f547-a0c7-4b08-8aa3-125c7afe4df8 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:52:51.283479 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-9986f547-a0c7-4b08-8aa3-125c7afe4df8 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] [instance: d0080e4b-6532-4e0c-8d19-cfbdf32e401b] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:52:51.298700 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-9986f547-a0c7-4b08-8aa3-125c7afe4df8 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:52:51.303414 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-9986f547-a0c7-4b08-8aa3-125c7afe4df8 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:52:51.304499 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-9986f547-a0c7-4b08-8aa3-125c7afe4df8 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:52:51.305990 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-9986f547-a0c7-4b08-8aa3-125c7afe4df8 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:52:51.485390 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-80f5b392-2af4-4cc1-aee2-c6a5abd711a0 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90033e5e8e634b699bf050e36519f8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8112a5759c444c1f94be24ab61bf072f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:52:51.492947 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-80f5b392-2af4-4cc1-aee2-c6a5abd711a0 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] 10.222.0.26 "GET /compute/v2.1/servers/39e14280-8730-41d3-993e-a158f0029386" status: 200 len: 1322 microversion: 2.1 time: 0.381889 Mar 05 02:52:51.502562 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 49/94] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:52:51 2022] GET /compute/v2.1/servers/39e14280-8730-41d3-993e-a158f0029386 => generated 1322 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 02:52:51.511135 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-706df5fb-04cb-442d-a5b4-164717cf24c1 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:52:51.511765 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-706df5fb-04cb-442d-a5b4-164717cf24c1 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] [instance: e28e570d-3d50-4fe8-bb4a-fe0e95c20fb7] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:52:51.520181 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-706df5fb-04cb-442d-a5b4-164717cf24c1 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:52:51.520649 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-706df5fb-04cb-442d-a5b4-164717cf24c1 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:52:51.521439 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-706df5fb-04cb-442d-a5b4-164717cf24c1 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:52:51.521886 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-706df5fb-04cb-442d-a5b4-164717cf24c1 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:52:51.646477 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-9986f547-a0c7-4b08-8aa3-125c7afe4df8 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e5a000087fe40419ccd0d1a96fb4783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9d27da2e71d4962a53a95efc46518ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:52:51.658488 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-9986f547-a0c7-4b08-8aa3-125c7afe4df8 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] 10.222.0.26 "GET /compute/v2.1/servers/d0080e4b-6532-4e0c-8d19-cfbdf32e401b" status: 200 len: 1363 microversion: 2.1 time: 0.377907 Mar 05 02:52:51.669191 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 46/95] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:52:51 2022] GET /compute/v2.1/servers/d0080e4b-6532-4e0c-8d19-cfbdf32e401b => generated 1363 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 02:52:51.789042 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-706df5fb-04cb-442d-a5b4-164717cf24c1 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:52:51.799627 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-706df5fb-04cb-442d-a5b4-164717cf24c1 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:52:51.801608 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-706df5fb-04cb-442d-a5b4-164717cf24c1 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:52:51.805234 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-706df5fb-04cb-442d-a5b4-164717cf24c1 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] 10.222.0.26 "GET /compute/v2.1/servers/e28e570d-3d50-4fe8-bb4a-fe0e95c20fb7" status: 200 len: 1407 microversion: 2.20 time: 0.306300 Mar 05 02:52:51.807434 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 50/96] 10.222.0.26 () {60 vars in 1276 bytes} [Sat Mar 5 02:52:51 2022] GET /compute/v2.1/servers/e28e570d-3d50-4fe8-bb4a-fe0e95c20fb7 => generated 1407 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 02:52:52.085564 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-79cadc28-8904-4e35-9307-2083f31e7761 tempest-DeleteServersTestJSON-1135736220 tempest-DeleteServersTestJSON-1135736220-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:52:52.086866 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-79cadc28-8904-4e35-9307-2083f31e7761 tempest-DeleteServersTestJSON-1135736220 tempest-DeleteServersTestJSON-1135736220-project] [instance: e848196a-c1b4-4e17-a748-aa877bce4650] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:52:52.127517 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-79cadc28-8904-4e35-9307-2083f31e7761 tempest-DeleteServersTestJSON-1135736220 tempest-DeleteServersTestJSON-1135736220-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:52:52.127976 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-79cadc28-8904-4e35-9307-2083f31e7761 tempest-DeleteServersTestJSON-1135736220 tempest-DeleteServersTestJSON-1135736220-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:52:52.128776 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-79cadc28-8904-4e35-9307-2083f31e7761 tempest-DeleteServersTestJSON-1135736220 tempest-DeleteServersTestJSON-1135736220-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:52:52.139653 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-79cadc28-8904-4e35-9307-2083f31e7761 tempest-DeleteServersTestJSON-1135736220 tempest-DeleteServersTestJSON-1135736220-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:52:52.181287 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-79cadc28-8904-4e35-9307-2083f31e7761 tempest-DeleteServersTestJSON-1135736220 tempest-DeleteServersTestJSON-1135736220-project] [instance: e848196a-c1b4-4e17-a748-aa877bce4650] Going to try to terminate instance {{(pid=123545) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 05 02:52:52.360696 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-79cadc28-8904-4e35-9307-2083f31e7761 tempest-DeleteServersTestJSON-1135736220 tempest-DeleteServersTestJSON-1135736220-project] 10.222.0.26 "DELETE /compute/v2.1/servers/e848196a-c1b4-4e17-a748-aa877bce4650" status: 204 len: 0 microversion: 2.1 time: 0.284724 Mar 05 02:52:52.362330 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 47/97] 10.222.0.26 () {58 vars in 1238 bytes} [Sat Mar 5 02:52:52 2022] DELETE /compute/v2.1/servers/e848196a-c1b4-4e17-a748-aa877bce4650 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 05 02:52:52.372523 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-39e34c1d-5025-4f15-9df7-517acf4fa79c tempest-DeleteServersTestJSON-1135736220 tempest-DeleteServersTestJSON-1135736220-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:52:52.373043 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-39e34c1d-5025-4f15-9df7-517acf4fa79c tempest-DeleteServersTestJSON-1135736220 tempest-DeleteServersTestJSON-1135736220-project] [instance: e848196a-c1b4-4e17-a748-aa877bce4650] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:52:52.382046 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-39e34c1d-5025-4f15-9df7-517acf4fa79c tempest-DeleteServersTestJSON-1135736220 tempest-DeleteServersTestJSON-1135736220-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:52:52.382513 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-39e34c1d-5025-4f15-9df7-517acf4fa79c tempest-DeleteServersTestJSON-1135736220 tempest-DeleteServersTestJSON-1135736220-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:52:52.383307 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-39e34c1d-5025-4f15-9df7-517acf4fa79c tempest-DeleteServersTestJSON-1135736220 tempest-DeleteServersTestJSON-1135736220-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:52:52.383753 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-39e34c1d-5025-4f15-9df7-517acf4fa79c tempest-DeleteServersTestJSON-1135736220 tempest-DeleteServersTestJSON-1135736220-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:52:52.511122 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-e537a18a-2bcc-4a30-8921-d7a572cfe5b3 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:52:52.511911 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-e537a18a-2bcc-4a30-8921-d7a572cfe5b3 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] [instance: 39e14280-8730-41d3-993e-a158f0029386] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:52:52.518860 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-e537a18a-2bcc-4a30-8921-d7a572cfe5b3 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:52:52.519405 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-e537a18a-2bcc-4a30-8921-d7a572cfe5b3 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:52:52.520295 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-e537a18a-2bcc-4a30-8921-d7a572cfe5b3 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:52:52.520806 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-e537a18a-2bcc-4a30-8921-d7a572cfe5b3 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:52:52.548145 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-39e34c1d-5025-4f15-9df7-517acf4fa79c tempest-DeleteServersTestJSON-1135736220 tempest-DeleteServersTestJSON-1135736220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22f302bdee4e47e79b975e5c0b88ff29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b241a841129430e93d2a9d0da408b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:52:52.559928 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-39e34c1d-5025-4f15-9df7-517acf4fa79c tempest-DeleteServersTestJSON-1135736220 tempest-DeleteServersTestJSON-1135736220-project] 10.222.0.26 "GET /compute/v2.1/servers/e848196a-c1b4-4e17-a748-aa877bce4650" status: 200 len: 1553 microversion: 2.1 time: 0.192499 Mar 05 02:52:52.561225 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 51/98] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:52:52 2022] GET /compute/v2.1/servers/e848196a-c1b4-4e17-a748-aa877bce4650 => generated 1553 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 02:52:52.636774 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [req-0330351f-326c-4c7b-acab-86e462594787 req-e0b8f87c-1ec8-424f-9f96-451c554b09e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c24fee69-5bf4-40f4-ba18-56aecd12dd96", "name": "network-vif-plugged", "status": "completed", "tag": "97ec8c13-e022-49e6-a358-8a738e1e166c"}, {"server_uuid": "39e14280-8730-41d3-993e-a158f0029386", "name": "network-vif-plugged", "status": "completed", "tag": "8647369d-1b5f-487f-be9a-cd16b07bda62"}, {"server_uuid": "d0080e4b-6532-4e0c-8d19-cfbdf32e401b", "name": "network-vif-plugged", "status": "completed", "tag": "f5a9d7d0-d2b2-401b-bf1a-016e681e13ff"}]} {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 02:52:52.646861 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [req-0330351f-326c-4c7b-acab-86e462594787 req-e0b8f87c-1ec8-424f-9f96-451c554b09e8 service nova] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:52:52.647625 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [req-0330351f-326c-4c7b-acab-86e462594787 req-e0b8f87c-1ec8-424f-9f96-451c554b09e8 service nova] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:52:52.661749 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.compute.server_external_events [req-0330351f-326c-4c7b-acab-86e462594787 req-e0b8f87c-1ec8-424f-9f96-451c554b09e8 service nova] Creating event network-vif-plugged:97ec8c13-e022-49e6-a358-8a738e1e166c for instance c24fee69-5bf4-40f4-ba18-56aecd12dd96 on hv-cinder-82725 Mar 05 02:52:52.662331 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.compute.server_external_events [req-0330351f-326c-4c7b-acab-86e462594787 req-e0b8f87c-1ec8-424f-9f96-451c554b09e8 service nova] Creating event network-vif-plugged:8647369d-1b5f-487f-be9a-cd16b07bda62 for instance 39e14280-8730-41d3-993e-a158f0029386 on hv-cinder-82725 Mar 05 02:52:52.662801 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.compute.server_external_events [req-0330351f-326c-4c7b-acab-86e462594787 req-e0b8f87c-1ec8-424f-9f96-451c554b09e8 service nova] Creating event network-vif-plugged:f5a9d7d0-d2b2-401b-bf1a-016e681e13ff for instance d0080e4b-6532-4e0c-8d19-cfbdf32e401b on hv-cinder-82725 Mar 05 02:52:52.672789 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [req-0330351f-326c-4c7b-acab-86e462594787 req-e0b8f87c-1ec8-424f-9f96-451c554b09e8 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.039408 Mar 05 02:52:52.677408 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 52/99] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Mar 5 02:52:52 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 02:52:52.681624 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-e537a18a-2bcc-4a30-8921-d7a572cfe5b3 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90033e5e8e634b699bf050e36519f8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8112a5759c444c1f94be24ab61bf072f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:52:52.683198 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-229cd6cf-ec5f-4599-bbc1-b866c49e1d70 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:52:52.684059 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-229cd6cf-ec5f-4599-bbc1-b866c49e1d70 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] [instance: d0080e4b-6532-4e0c-8d19-cfbdf32e401b] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:52:52.689987 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-e537a18a-2bcc-4a30-8921-d7a572cfe5b3 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] 10.222.0.26 "GET /compute/v2.1/servers/39e14280-8730-41d3-993e-a158f0029386" status: 200 len: 1322 microversion: 2.1 time: 0.183845 Mar 05 02:52:52.691223 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 48/100] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:52:52 2022] GET /compute/v2.1/servers/39e14280-8730-41d3-993e-a158f0029386 => generated 1322 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 02:52:52.705428 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-229cd6cf-ec5f-4599-bbc1-b866c49e1d70 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:52:52.706081 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-229cd6cf-ec5f-4599-bbc1-b866c49e1d70 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:52:52.707189 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-229cd6cf-ec5f-4599-bbc1-b866c49e1d70 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:52:52.707653 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-229cd6cf-ec5f-4599-bbc1-b866c49e1d70 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:52:52.826157 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-64ca5026-f9eb-459c-86b4-bb8fdbf7987c tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:52:52.826943 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-64ca5026-f9eb-459c-86b4-bb8fdbf7987c tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] [instance: e28e570d-3d50-4fe8-bb4a-fe0e95c20fb7] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:52:52.842123 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-64ca5026-f9eb-459c-86b4-bb8fdbf7987c tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:52:52.842603 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-64ca5026-f9eb-459c-86b4-bb8fdbf7987c tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:52:52.844422 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-64ca5026-f9eb-459c-86b4-bb8fdbf7987c tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:52:52.844876 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-64ca5026-f9eb-459c-86b4-bb8fdbf7987c tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:52:53.061862 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-229cd6cf-ec5f-4599-bbc1-b866c49e1d70 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e5a000087fe40419ccd0d1a96fb4783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9d27da2e71d4962a53a95efc46518ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:52:53.073022 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-229cd6cf-ec5f-4599-bbc1-b866c49e1d70 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] 10.222.0.26 "GET /compute/v2.1/servers/d0080e4b-6532-4e0c-8d19-cfbdf32e401b" status: 200 len: 1363 microversion: 2.1 time: 0.394118 Mar 05 02:52:53.091738 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 53/101] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:52:52 2022] GET /compute/v2.1/servers/d0080e4b-6532-4e0c-8d19-cfbdf32e401b => generated 1363 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 02:52:53.362996 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-64ca5026-f9eb-459c-86b4-bb8fdbf7987c tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:52:53.373423 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-64ca5026-f9eb-459c-86b4-bb8fdbf7987c tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:52:53.376938 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-64ca5026-f9eb-459c-86b4-bb8fdbf7987c tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:52:53.378293 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-64ca5026-f9eb-459c-86b4-bb8fdbf7987c tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] 10.222.0.26 "GET /compute/v2.1/servers/e28e570d-3d50-4fe8-bb4a-fe0e95c20fb7" status: 200 len: 1599 microversion: 2.20 time: 0.556022 Mar 05 02:52:53.389427 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 49/102] 10.222.0.26 () {60 vars in 1276 bytes} [Sat Mar 5 02:52:52 2022] GET /compute/v2.1/servers/e28e570d-3d50-4fe8-bb4a-fe0e95c20fb7 => generated 1599 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 02:52:53.402457 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-081f2d43-b295-4a3b-9288-9491fd2035a9 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:52:53.403258 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-081f2d43-b295-4a3b-9288-9491fd2035a9 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] [instance: e28e570d-3d50-4fe8-bb4a-fe0e95c20fb7] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:52:53.411726 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-081f2d43-b295-4a3b-9288-9491fd2035a9 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:52:53.412303 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-081f2d43-b295-4a3b-9288-9491fd2035a9 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:52:53.413177 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-081f2d43-b295-4a3b-9288-9491fd2035a9 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:52:53.413830 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-081f2d43-b295-4a3b-9288-9491fd2035a9 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:52:53.539408 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-081f2d43-b295-4a3b-9288-9491fd2035a9 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] 10.222.0.26 "GET /compute/v2.1/servers/e28e570d-3d50-4fe8-bb4a-fe0e95c20fb7/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.145371 Mar 05 02:52:53.540010 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 54/103] 10.222.0.26 () {60 vars in 1315 bytes} [Sat Mar 5 02:52:53 2022] GET /compute/v2.1/servers/e28e570d-3d50-4fe8-bb4a-fe0e95c20fb7/os-interface => generated 284 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 05 02:52:53.579031 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-3853a279-0312-4387-819e-3f906d7482a6 tempest-DeleteServersTestJSON-1135736220 tempest-DeleteServersTestJSON-1135736220-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:52:53.587414 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-3853a279-0312-4387-819e-3f906d7482a6 tempest-DeleteServersTestJSON-1135736220 tempest-DeleteServersTestJSON-1135736220-project] [instance: e848196a-c1b4-4e17-a748-aa877bce4650] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:52:53.599004 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-3853a279-0312-4387-819e-3f906d7482a6 tempest-DeleteServersTestJSON-1135736220 tempest-DeleteServersTestJSON-1135736220-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:52:53.600114 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-3853a279-0312-4387-819e-3f906d7482a6 tempest-DeleteServersTestJSON-1135736220 tempest-DeleteServersTestJSON-1135736220-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:52:53.600981 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-3853a279-0312-4387-819e-3f906d7482a6 tempest-DeleteServersTestJSON-1135736220 tempest-DeleteServersTestJSON-1135736220-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:52:53.601424 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-3853a279-0312-4387-819e-3f906d7482a6 tempest-DeleteServersTestJSON-1135736220 tempest-DeleteServersTestJSON-1135736220-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:52:53.709244 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-d6fb3c8c-09cf-485c-bbd2-bdea7d0b7a21 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:52:53.710618 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-d6fb3c8c-09cf-485c-bbd2-bdea7d0b7a21 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] [instance: 39e14280-8730-41d3-993e-a158f0029386] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:52:53.724201 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-d6fb3c8c-09cf-485c-bbd2-bdea7d0b7a21 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:52:53.726265 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-d6fb3c8c-09cf-485c-bbd2-bdea7d0b7a21 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:52:53.728131 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-d6fb3c8c-09cf-485c-bbd2-bdea7d0b7a21 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:52:53.731089 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-d6fb3c8c-09cf-485c-bbd2-bdea7d0b7a21 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:52:54.292436 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-d6fb3c8c-09cf-485c-bbd2-bdea7d0b7a21 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90033e5e8e634b699bf050e36519f8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8112a5759c444c1f94be24ab61bf072f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:52:54.301425 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-d6fb3c8c-09cf-485c-bbd2-bdea7d0b7a21 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] 10.222.0.26 "GET /compute/v2.1/servers/39e14280-8730-41d3-993e-a158f0029386" status: 200 len: 1322 microversion: 2.1 time: 0.598435 Mar 05 02:52:54.313973 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 55/104] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:52:53 2022] GET /compute/v2.1/servers/39e14280-8730-41d3-993e-a158f0029386 => generated 1322 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 02:52:54.320397 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-b2401a8b-2909-416b-a62a-aa7ad4f60a25 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:52:54.320564 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-b2401a8b-2909-416b-a62a-aa7ad4f60a25 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] [instance: d0080e4b-6532-4e0c-8d19-cfbdf32e401b] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:52:54.338243 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-b2401a8b-2909-416b-a62a-aa7ad4f60a25 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:52:54.338540 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-b2401a8b-2909-416b-a62a-aa7ad4f60a25 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:52:54.339327 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-b2401a8b-2909-416b-a62a-aa7ad4f60a25 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:52:54.339777 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-b2401a8b-2909-416b-a62a-aa7ad4f60a25 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:52:54.556183 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-3853a279-0312-4387-819e-3f906d7482a6 tempest-DeleteServersTestJSON-1135736220 tempest-DeleteServersTestJSON-1135736220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22f302bdee4e47e79b975e5c0b88ff29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b241a841129430e93d2a9d0da408b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:52:54.565003 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-3853a279-0312-4387-819e-3f906d7482a6 tempest-DeleteServersTestJSON-1135736220 tempest-DeleteServersTestJSON-1135736220-project] 10.222.0.26 "GET /compute/v2.1/servers/e848196a-c1b4-4e17-a748-aa877bce4650" status: 200 len: 1553 microversion: 2.1 time: 0.990249 Mar 05 02:52:54.565580 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 50/105] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:52:53 2022] GET /compute/v2.1/servers/e848196a-c1b4-4e17-a748-aa877bce4650 => generated 1553 bytes in 992 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 02:52:54.844959 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-b2401a8b-2909-416b-a62a-aa7ad4f60a25 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e5a000087fe40419ccd0d1a96fb4783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9d27da2e71d4962a53a95efc46518ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:52:54.852459 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-b2401a8b-2909-416b-a62a-aa7ad4f60a25 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] 10.222.0.26 "GET /compute/v2.1/servers/d0080e4b-6532-4e0c-8d19-cfbdf32e401b" status: 200 len: 1363 microversion: 2.1 time: 0.537272 Mar 05 02:52:54.856971 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 56/106] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:52:54 2022] GET /compute/v2.1/servers/d0080e4b-6532-4e0c-8d19-cfbdf32e401b => generated 1363 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 02:52:55.319690 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-d4e93c4b-d12a-4726-941a-455788e84e45 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:52:55.320404 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-d4e93c4b-d12a-4726-941a-455788e84e45 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] [instance: 39e14280-8730-41d3-993e-a158f0029386] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:52:55.338777 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-d4e93c4b-d12a-4726-941a-455788e84e45 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:52:55.339320 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-d4e93c4b-d12a-4726-941a-455788e84e45 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:52:55.340184 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-d4e93c4b-d12a-4726-941a-455788e84e45 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:52:55.342289 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-d4e93c4b-d12a-4726-941a-455788e84e45 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:52:55.582132 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-e65d741c-a069-481a-8b5e-ba0a510c0898 tempest-DeleteServersTestJSON-1135736220 tempest-DeleteServersTestJSON-1135736220-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:52:55.582927 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-e65d741c-a069-481a-8b5e-ba0a510c0898 tempest-DeleteServersTestJSON-1135736220 tempest-DeleteServersTestJSON-1135736220-project] [instance: e848196a-c1b4-4e17-a748-aa877bce4650] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:52:55.589582 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-e65d741c-a069-481a-8b5e-ba0a510c0898 tempest-DeleteServersTestJSON-1135736220 tempest-DeleteServersTestJSON-1135736220-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:52:55.590268 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-e65d741c-a069-481a-8b5e-ba0a510c0898 tempest-DeleteServersTestJSON-1135736220 tempest-DeleteServersTestJSON-1135736220-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:52:55.591054 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-e65d741c-a069-481a-8b5e-ba0a510c0898 tempest-DeleteServersTestJSON-1135736220 tempest-DeleteServersTestJSON-1135736220-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:52:55.591694 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-e65d741c-a069-481a-8b5e-ba0a510c0898 tempest-DeleteServersTestJSON-1135736220 tempest-DeleteServersTestJSON-1135736220-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:52:55.760470 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-d4e93c4b-d12a-4726-941a-455788e84e45 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90033e5e8e634b699bf050e36519f8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8112a5759c444c1f94be24ab61bf072f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:52:55.767942 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-d4e93c4b-d12a-4726-941a-455788e84e45 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] 10.222.0.26 "GET /compute/v2.1/servers/39e14280-8730-41d3-993e-a158f0029386" status: 200 len: 1516 microversion: 2.1 time: 0.452018 Mar 05 02:52:55.768764 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 51/107] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:52:55 2022] GET /compute/v2.1/servers/39e14280-8730-41d3-993e-a158f0029386 => generated 1516 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 02:52:55.785138 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-6c73cbc6-f996-4e53-9bca-95e8aa43cd4d tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 02:52:55.786449 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-6c73cbc6-f996-4e53-9bca-95e8aa43cd4d tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] [instance: 39e14280-8730-41d3-993e-a158f0029386] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:52:55.792712 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-6c73cbc6-f996-4e53-9bca-95e8aa43cd4d tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:52:55.793469 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-6c73cbc6-f996-4e53-9bca-95e8aa43cd4d tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:52:55.794479 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-6c73cbc6-f996-4e53-9bca-95e8aa43cd4d tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:52:55.795279 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-6c73cbc6-f996-4e53-9bca-95e8aa43cd4d tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:52:55.821548 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.objects.instance [None req-6c73cbc6-f996-4e53-9bca-95e8aa43cd4d tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lazy-loading 'flavor' on Instance uuid 39e14280-8730-41d3-993e-a158f0029386 {{(pid=123545) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 05 02:52:55.952022 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-6c73cbc6-f996-4e53-9bca-95e8aa43cd4d tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] 10.222.0.26 "POST /compute/v2.1/servers/39e14280-8730-41d3-993e-a158f0029386/action" status: 200 len: 32 microversion: 2.1 time: 0.170507 Mar 05 02:52:55.953513 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 52/108] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Mar 5 02:52:55 2022] POST /compute/v2.1/servers/39e14280-8730-41d3-993e-a158f0029386/action => generated 32 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 05 02:52:55.963774 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-a3260885-c8e9-44c5-9dea-2dbcce38e328 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:52:55.964552 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-a3260885-c8e9-44c5-9dea-2dbcce38e328 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] [instance: d0080e4b-6532-4e0c-8d19-cfbdf32e401b] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:52:55.974605 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-a3260885-c8e9-44c5-9dea-2dbcce38e328 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:52:55.975082 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-a3260885-c8e9-44c5-9dea-2dbcce38e328 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:52:55.976045 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-a3260885-c8e9-44c5-9dea-2dbcce38e328 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:52:55.976579 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-a3260885-c8e9-44c5-9dea-2dbcce38e328 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:52:56.357647 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-e65d741c-a069-481a-8b5e-ba0a510c0898 tempest-DeleteServersTestJSON-1135736220 tempest-DeleteServersTestJSON-1135736220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22f302bdee4e47e79b975e5c0b88ff29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b241a841129430e93d2a9d0da408b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:52:56.369989 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-e65d741c-a069-481a-8b5e-ba0a510c0898 tempest-DeleteServersTestJSON-1135736220 tempest-DeleteServersTestJSON-1135736220-project] 10.222.0.26 "GET /compute/v2.1/servers/e848196a-c1b4-4e17-a748-aa877bce4650" status: 200 len: 1553 microversion: 2.1 time: 0.790529 Mar 05 02:52:56.370633 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 57/109] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:52:55 2022] GET /compute/v2.1/servers/e848196a-c1b4-4e17-a748-aa877bce4650 => generated 1553 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 02:52:56.378387 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-c3d03dcd-ee29-4a56-a063-04c2b23ab4c1 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:52:56.378996 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-c3d03dcd-ee29-4a56-a063-04c2b23ab4c1 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] [instance: 39e14280-8730-41d3-993e-a158f0029386] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:52:56.386141 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-c3d03dcd-ee29-4a56-a063-04c2b23ab4c1 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:52:56.386642 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-c3d03dcd-ee29-4a56-a063-04c2b23ab4c1 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:52:56.395661 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-c3d03dcd-ee29-4a56-a063-04c2b23ab4c1 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:52:56.396134 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-c3d03dcd-ee29-4a56-a063-04c2b23ab4c1 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:52:56.559051 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-a3260885-c8e9-44c5-9dea-2dbcce38e328 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e5a000087fe40419ccd0d1a96fb4783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9d27da2e71d4962a53a95efc46518ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:52:56.572954 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-a3260885-c8e9-44c5-9dea-2dbcce38e328 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] 10.222.0.26 "GET /compute/v2.1/servers/d0080e4b-6532-4e0c-8d19-cfbdf32e401b" status: 200 len: 1549 microversion: 2.1 time: 0.613629 Mar 05 02:52:56.573576 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 53/110] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:52:55 2022] GET /compute/v2.1/servers/d0080e4b-6532-4e0c-8d19-cfbdf32e401b => generated 1549 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 02:52:56.578660 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [req-93236bab-410c-4319-926a-e48e5ba689ba req-52f31b97-fc28-4adf-9013-229be553a72e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e28e570d-3d50-4fe8-bb4a-fe0e95c20fb7", "tag": "f280dd1a-3e15-49a1-9569-b6b40278e2a2"}]} {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 02:52:56.613176 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [req-93236bab-410c-4319-926a-e48e5ba689ba req-52f31b97-fc28-4adf-9013-229be553a72e service nova] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:52:56.614960 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [req-93236bab-410c-4319-926a-e48e5ba689ba req-52f31b97-fc28-4adf-9013-229be553a72e service nova] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:52:56.631112 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.compute.server_external_events [req-93236bab-410c-4319-926a-e48e5ba689ba req-52f31b97-fc28-4adf-9013-229be553a72e service nova] Creating event network-changed:f280dd1a-3e15-49a1-9569-b6b40278e2a2 for instance e28e570d-3d50-4fe8-bb4a-fe0e95c20fb7 on hv-cinder-82725 Mar 05 02:52:56.635044 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [req-93236bab-410c-4319-926a-e48e5ba689ba req-52f31b97-fc28-4adf-9013-229be553a72e service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060150 Mar 05 02:52:56.636053 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 54/111] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Mar 5 02:52:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 02:52:56.642919 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-134e5cf6-ca1d-448c-bd2d-6eb215b1bd77 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:52:56.644060 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-134e5cf6-ca1d-448c-bd2d-6eb215b1bd77 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] [instance: d0080e4b-6532-4e0c-8d19-cfbdf32e401b] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:52:56.651937 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-134e5cf6-ca1d-448c-bd2d-6eb215b1bd77 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:52:56.653004 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-134e5cf6-ca1d-448c-bd2d-6eb215b1bd77 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:52:56.654241 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-134e5cf6-ca1d-448c-bd2d-6eb215b1bd77 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:52:56.654949 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-134e5cf6-ca1d-448c-bd2d-6eb215b1bd77 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:52:56.816732 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-c3d03dcd-ee29-4a56-a063-04c2b23ab4c1 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90033e5e8e634b699bf050e36519f8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8112a5759c444c1f94be24ab61bf072f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:52:56.824293 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-c3d03dcd-ee29-4a56-a063-04c2b23ab4c1 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] 10.222.0.26 "GET /compute/v2.1/servers/39e14280-8730-41d3-993e-a158f0029386" status: 200 len: 1522 microversion: 2.1 time: 0.451427 Mar 05 02:52:56.825493 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 58/112] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:52:56 2022] GET /compute/v2.1/servers/39e14280-8730-41d3-993e-a158f0029386 => generated 1522 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 02:52:56.841554 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-134e5cf6-ca1d-448c-bd2d-6eb215b1bd77 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] 10.222.0.26 "GET /compute/v2.1/servers/d0080e4b-6532-4e0c-8d19-cfbdf32e401b/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.204121 Mar 05 02:52:56.842175 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 55/113] 10.222.0.26 () {58 vars in 1274 bytes} [Sat Mar 5 02:52:56 2022] GET /compute/v2.1/servers/d0080e4b-6532-4e0c-8d19-cfbdf32e401b/os-interface => generated 284 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 02:52:57.389242 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-754d4c90-c8a9-4d9a-a633-d57a40cae72c tempest-DeleteServersTestJSON-1135736220 tempest-DeleteServersTestJSON-1135736220-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:52:57.391635 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-754d4c90-c8a9-4d9a-a633-d57a40cae72c tempest-DeleteServersTestJSON-1135736220 tempest-DeleteServersTestJSON-1135736220-project] [instance: e848196a-c1b4-4e17-a748-aa877bce4650] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:52:57.401305 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-754d4c90-c8a9-4d9a-a633-d57a40cae72c tempest-DeleteServersTestJSON-1135736220 tempest-DeleteServersTestJSON-1135736220-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:52:57.402684 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-754d4c90-c8a9-4d9a-a633-d57a40cae72c tempest-DeleteServersTestJSON-1135736220 tempest-DeleteServersTestJSON-1135736220-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:52:57.403707 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-754d4c90-c8a9-4d9a-a633-d57a40cae72c tempest-DeleteServersTestJSON-1135736220 tempest-DeleteServersTestJSON-1135736220-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:52:57.404509 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-754d4c90-c8a9-4d9a-a633-d57a40cae72c tempest-DeleteServersTestJSON-1135736220 tempest-DeleteServersTestJSON-1135736220-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:52:57.542715 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-754d4c90-c8a9-4d9a-a633-d57a40cae72c tempest-DeleteServersTestJSON-1135736220 tempest-DeleteServersTestJSON-1135736220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22f302bdee4e47e79b975e5c0b88ff29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b241a841129430e93d2a9d0da408b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:52:57.552371 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-754d4c90-c8a9-4d9a-a633-d57a40cae72c tempest-DeleteServersTestJSON-1135736220 tempest-DeleteServersTestJSON-1135736220-project] 10.222.0.26 "GET /compute/v2.1/servers/e848196a-c1b4-4e17-a748-aa877bce4650" status: 200 len: 1511 microversion: 2.1 time: 0.168952 Mar 05 02:52:57.553152 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 59/114] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:52:57 2022] GET /compute/v2.1/servers/e848196a-c1b4-4e17-a748-aa877bce4650 => generated 1511 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 02:52:57.841496 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-592ffe84-5d99-4f1b-88bd-521ce9871924 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:52:57.842659 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-592ffe84-5d99-4f1b-88bd-521ce9871924 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] [instance: 39e14280-8730-41d3-993e-a158f0029386] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:52:57.851618 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-592ffe84-5d99-4f1b-88bd-521ce9871924 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:52:57.852686 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-592ffe84-5d99-4f1b-88bd-521ce9871924 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:52:57.854133 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-592ffe84-5d99-4f1b-88bd-521ce9871924 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:52:57.855020 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-592ffe84-5d99-4f1b-88bd-521ce9871924 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:52:58.060403 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-592ffe84-5d99-4f1b-88bd-521ce9871924 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90033e5e8e634b699bf050e36519f8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8112a5759c444c1f94be24ab61bf072f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:52:58.069186 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-592ffe84-5d99-4f1b-88bd-521ce9871924 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] 10.222.0.26 "GET /compute/v2.1/servers/39e14280-8730-41d3-993e-a158f0029386" status: 200 len: 1522 microversion: 2.1 time: 0.231440 Mar 05 02:52:58.078978 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 56/115] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:52:57 2022] GET /compute/v2.1/servers/39e14280-8730-41d3-993e-a158f0029386 => generated 1522 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 02:52:58.377033 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [req-eb5be10b-c6b3-4f58-b7c7-7daf862246d4 req-e533f2d3-2807-46ef-ad7a-9e5a13d02956 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d0080e4b-6532-4e0c-8d19-cfbdf32e401b", "tag": "f5a9d7d0-d2b2-401b-bf1a-016e681e13ff"}]} {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 02:52:58.383221 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [req-eb5be10b-c6b3-4f58-b7c7-7daf862246d4 req-e533f2d3-2807-46ef-ad7a-9e5a13d02956 service nova] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:52:58.383671 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [req-eb5be10b-c6b3-4f58-b7c7-7daf862246d4 req-e533f2d3-2807-46ef-ad7a-9e5a13d02956 service nova] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:52:58.395063 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.compute.server_external_events [req-eb5be10b-c6b3-4f58-b7c7-7daf862246d4 req-e533f2d3-2807-46ef-ad7a-9e5a13d02956 service nova] Creating event network-changed:f5a9d7d0-d2b2-401b-bf1a-016e681e13ff for instance d0080e4b-6532-4e0c-8d19-cfbdf32e401b on hv-cinder-82725 Mar 05 02:52:58.400204 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [req-eb5be10b-c6b3-4f58-b7c7-7daf862246d4 req-e533f2d3-2807-46ef-ad7a-9e5a13d02956 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029988 Mar 05 02:52:58.401095 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 60/116] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Mar 5 02:52:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 02:52:58.570466 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-e4575197-7099-411f-8d43-93d94e8e213e tempest-DeleteServersTestJSON-1135736220 tempest-DeleteServersTestJSON-1135736220-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:52:58.571784 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-e4575197-7099-411f-8d43-93d94e8e213e tempest-DeleteServersTestJSON-1135736220 tempest-DeleteServersTestJSON-1135736220-project] [instance: e848196a-c1b4-4e17-a748-aa877bce4650] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:52:58.580150 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-e4575197-7099-411f-8d43-93d94e8e213e tempest-DeleteServersTestJSON-1135736220 tempest-DeleteServersTestJSON-1135736220-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:52:58.580575 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-e4575197-7099-411f-8d43-93d94e8e213e tempest-DeleteServersTestJSON-1135736220 tempest-DeleteServersTestJSON-1135736220-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:52:58.581356 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-e4575197-7099-411f-8d43-93d94e8e213e tempest-DeleteServersTestJSON-1135736220 tempest-DeleteServersTestJSON-1135736220-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:52:58.581786 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-e4575197-7099-411f-8d43-93d94e8e213e tempest-DeleteServersTestJSON-1135736220 tempest-DeleteServersTestJSON-1135736220-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:52:58.667976 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [req-dc7b0447-bc8c-4075-9e6b-ae73afb38e29 req-202f36c8-a6df-4c36-9765-36e6bd9fa323 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e848196a-c1b4-4e17-a748-aa877bce4650", "name": "network-vif-deleted", "tag": "befe3005-c145-4b53-b393-98b7075cb75b"}]} {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 02:52:58.669374 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-e4575197-7099-411f-8d43-93d94e8e213e tempest-DeleteServersTestJSON-1135736220 tempest-DeleteServersTestJSON-1135736220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22f302bdee4e47e79b975e5c0b88ff29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b241a841129430e93d2a9d0da408b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:52:58.681077 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-e4575197-7099-411f-8d43-93d94e8e213e tempest-DeleteServersTestJSON-1135736220 tempest-DeleteServersTestJSON-1135736220-project] 10.222.0.26 "GET /compute/v2.1/servers/e848196a-c1b4-4e17-a748-aa877bce4650" status: 200 len: 1511 microversion: 2.1 time: 0.115449 Mar 05 02:52:58.691614 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 57/117] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:52:58 2022] GET /compute/v2.1/servers/e848196a-c1b4-4e17-a748-aa877bce4650 => generated 1511 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 02:52:58.695750 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [req-dc7b0447-bc8c-4075-9e6b-ae73afb38e29 req-202f36c8-a6df-4c36-9765-36e6bd9fa323 service nova] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:52:58.696373 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [req-dc7b0447-bc8c-4075-9e6b-ae73afb38e29 req-202f36c8-a6df-4c36-9765-36e6bd9fa323 service nova] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:52:58.710308 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.compute.server_external_events [req-dc7b0447-bc8c-4075-9e6b-ae73afb38e29 req-202f36c8-a6df-4c36-9765-36e6bd9fa323 service nova] Creating event network-vif-deleted:befe3005-c145-4b53-b393-98b7075cb75b for instance e848196a-c1b4-4e17-a748-aa877bce4650 on hv-cinder-82725 Mar 05 02:52:58.716078 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [req-dc7b0447-bc8c-4075-9e6b-ae73afb38e29 req-202f36c8-a6df-4c36-9765-36e6bd9fa323 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052283 Mar 05 02:52:58.717181 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 61/118] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Mar 5 02:52:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 05 02:52:59.086653 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-c947e75f-b45f-4a52-a9e9-6df1f59d9684 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:52:59.087442 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-c947e75f-b45f-4a52-a9e9-6df1f59d9684 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] [instance: 39e14280-8730-41d3-993e-a158f0029386] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:52:59.094620 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-c947e75f-b45f-4a52-a9e9-6df1f59d9684 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:52:59.095269 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-c947e75f-b45f-4a52-a9e9-6df1f59d9684 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:52:59.096170 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-c947e75f-b45f-4a52-a9e9-6df1f59d9684 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:52:59.096718 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-c947e75f-b45f-4a52-a9e9-6df1f59d9684 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:52:59.343336 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-c947e75f-b45f-4a52-a9e9-6df1f59d9684 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90033e5e8e634b699bf050e36519f8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8112a5759c444c1f94be24ab61bf072f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:52:59.367019 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-c947e75f-b45f-4a52-a9e9-6df1f59d9684 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] 10.222.0.26 "GET /compute/v2.1/servers/39e14280-8730-41d3-993e-a158f0029386" status: 200 len: 1522 microversion: 2.1 time: 0.284153 Mar 05 02:52:59.368263 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 58/119] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:52:59 2022] GET /compute/v2.1/servers/39e14280-8730-41d3-993e-a158f0029386 => generated 1522 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 02:52:59.704076 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-a5ef97f7-a495-4847-8929-0b10c243cd46 tempest-DeleteServersTestJSON-1135736220 tempest-DeleteServersTestJSON-1135736220-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:52:59.704830 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-a5ef97f7-a495-4847-8929-0b10c243cd46 tempest-DeleteServersTestJSON-1135736220 tempest-DeleteServersTestJSON-1135736220-project] [instance: e848196a-c1b4-4e17-a748-aa877bce4650] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:52:59.721184 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-a5ef97f7-a495-4847-8929-0b10c243cd46 tempest-DeleteServersTestJSON-1135736220 tempest-DeleteServersTestJSON-1135736220-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:52:59.721680 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-a5ef97f7-a495-4847-8929-0b10c243cd46 tempest-DeleteServersTestJSON-1135736220 tempest-DeleteServersTestJSON-1135736220-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:52:59.723086 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-a5ef97f7-a495-4847-8929-0b10c243cd46 tempest-DeleteServersTestJSON-1135736220 tempest-DeleteServersTestJSON-1135736220-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:52:59.723914 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-a5ef97f7-a495-4847-8929-0b10c243cd46 tempest-DeleteServersTestJSON-1135736220 tempest-DeleteServersTestJSON-1135736220-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:53:00.013114 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-a5ef97f7-a495-4847-8929-0b10c243cd46 tempest-DeleteServersTestJSON-1135736220 tempest-DeleteServersTestJSON-1135736220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22f302bdee4e47e79b975e5c0b88ff29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b241a841129430e93d2a9d0da408b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:53:00.037506 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-a5ef97f7-a495-4847-8929-0b10c243cd46 tempest-DeleteServersTestJSON-1135736220 tempest-DeleteServersTestJSON-1135736220-project] 10.222.0.26 "GET /compute/v2.1/servers/e848196a-c1b4-4e17-a748-aa877bce4650" status: 200 len: 1345 microversion: 2.1 time: 0.341953 Mar 05 02:53:00.041381 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 62/120] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:52:59 2022] GET /compute/v2.1/servers/e848196a-c1b4-4e17-a748-aa877bce4650 => generated 1345 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 02:53:00.384103 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-fa0920bf-1ae4-49e9-bf5b-5d4d7e570d8b tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:53:00.384697 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-fa0920bf-1ae4-49e9-bf5b-5d4d7e570d8b tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] [instance: 39e14280-8730-41d3-993e-a158f0029386] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:53:00.393838 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-fa0920bf-1ae4-49e9-bf5b-5d4d7e570d8b tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:53:00.394542 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-fa0920bf-1ae4-49e9-bf5b-5d4d7e570d8b tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:53:00.395480 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-fa0920bf-1ae4-49e9-bf5b-5d4d7e570d8b tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:53:00.399129 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-fa0920bf-1ae4-49e9-bf5b-5d4d7e570d8b tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:53:00.694742 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-fa0920bf-1ae4-49e9-bf5b-5d4d7e570d8b tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90033e5e8e634b699bf050e36519f8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8112a5759c444c1f94be24ab61bf072f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:53:00.705732 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-fa0920bf-1ae4-49e9-bf5b-5d4d7e570d8b tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] 10.222.0.26 "GET /compute/v2.1/servers/39e14280-8730-41d3-993e-a158f0029386" status: 200 len: 1522 microversion: 2.1 time: 0.325306 Mar 05 02:53:00.716460 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 59/121] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:53:00 2022] GET /compute/v2.1/servers/39e14280-8730-41d3-993e-a158f0029386 => generated 1522 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 02:53:01.057315 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-e7ebf8a3-4ac6-43d6-b098-7a7826d4da0e tempest-DeleteServersTestJSON-1135736220 tempest-DeleteServersTestJSON-1135736220-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:53:01.057995 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-e7ebf8a3-4ac6-43d6-b098-7a7826d4da0e tempest-DeleteServersTestJSON-1135736220 tempest-DeleteServersTestJSON-1135736220-project] [instance: e848196a-c1b4-4e17-a748-aa877bce4650] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:53:01.064506 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-e7ebf8a3-4ac6-43d6-b098-7a7826d4da0e tempest-DeleteServersTestJSON-1135736220 tempest-DeleteServersTestJSON-1135736220-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:53:01.064848 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-e7ebf8a3-4ac6-43d6-b098-7a7826d4da0e tempest-DeleteServersTestJSON-1135736220 tempest-DeleteServersTestJSON-1135736220-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:53:01.065615 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-e7ebf8a3-4ac6-43d6-b098-7a7826d4da0e tempest-DeleteServersTestJSON-1135736220 tempest-DeleteServersTestJSON-1135736220-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:53:01.066074 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-e7ebf8a3-4ac6-43d6-b098-7a7826d4da0e tempest-DeleteServersTestJSON-1135736220 tempest-DeleteServersTestJSON-1135736220-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:53:01.080374 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.wsgi [None req-e7ebf8a3-4ac6-43d6-b098-7a7826d4da0e tempest-DeleteServersTestJSON-1135736220 tempest-DeleteServersTestJSON-1135736220-project] HTTP exception thrown: Instance e848196a-c1b4-4e17-a748-aa877bce4650 could not be found. Mar 05 02:53:01.080971 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-e7ebf8a3-4ac6-43d6-b098-7a7826d4da0e tempest-DeleteServersTestJSON-1135736220 tempest-DeleteServersTestJSON-1135736220-project] Returning 404 to user: Instance e848196a-c1b4-4e17-a748-aa877bce4650 could not be found. {{(pid=123546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 02:53:01.081842 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-e7ebf8a3-4ac6-43d6-b098-7a7826d4da0e tempest-DeleteServersTestJSON-1135736220 tempest-DeleteServersTestJSON-1135736220-project] 10.222.0.26 "GET /compute/v2.1/servers/e848196a-c1b4-4e17-a748-aa877bce4650" status: 404 len: 111 microversion: 2.1 time: 0.028311 Mar 05 02:53:01.082427 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 63/122] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:53:01 2022] GET /compute/v2.1/servers/e848196a-c1b4-4e17-a748-aa877bce4650 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 05 02:53:01.189337 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-ab5406f9-5200-4089-8fca-7a7c92294d88 tempest-DeleteServersTestJSON-1135736220 tempest-DeleteServersTestJSON-1135736220-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:53:01.190288 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-ab5406f9-5200-4089-8fca-7a7c92294d88 tempest-DeleteServersTestJSON-1135736220 tempest-DeleteServersTestJSON-1135736220-project] [instance: e848196a-c1b4-4e17-a748-aa877bce4650] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:53:01.196233 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-ab5406f9-5200-4089-8fca-7a7c92294d88 tempest-DeleteServersTestJSON-1135736220 tempest-DeleteServersTestJSON-1135736220-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:53:01.196753 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-ab5406f9-5200-4089-8fca-7a7c92294d88 tempest-DeleteServersTestJSON-1135736220 tempest-DeleteServersTestJSON-1135736220-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:53:01.197526 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-ab5406f9-5200-4089-8fca-7a7c92294d88 tempest-DeleteServersTestJSON-1135736220 tempest-DeleteServersTestJSON-1135736220-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:53:01.198038 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-ab5406f9-5200-4089-8fca-7a7c92294d88 tempest-DeleteServersTestJSON-1135736220 tempest-DeleteServersTestJSON-1135736220-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:53:01.211585 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.wsgi [None req-ab5406f9-5200-4089-8fca-7a7c92294d88 tempest-DeleteServersTestJSON-1135736220 tempest-DeleteServersTestJSON-1135736220-project] HTTP exception thrown: Instance e848196a-c1b4-4e17-a748-aa877bce4650 could not be found. Mar 05 02:53:01.212315 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-ab5406f9-5200-4089-8fca-7a7c92294d88 tempest-DeleteServersTestJSON-1135736220 tempest-DeleteServersTestJSON-1135736220-project] Returning 404 to user: Instance e848196a-c1b4-4e17-a748-aa877bce4650 could not be found. {{(pid=123545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 02:53:01.215843 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-ab5406f9-5200-4089-8fca-7a7c92294d88 tempest-DeleteServersTestJSON-1135736220 tempest-DeleteServersTestJSON-1135736220-project] 10.222.0.26 "GET /compute/v2.1/servers/e848196a-c1b4-4e17-a748-aa877bce4650/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.031155 Mar 05 02:53:01.216400 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 60/123] 10.222.0.26 () {58 vars in 1301 bytes} [Sat Mar 5 02:53:01 2022] GET /compute/v2.1/servers/e848196a-c1b4-4e17-a748-aa877bce4650/os-volume_attachments => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 05 02:53:01.724014 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-6256a97e-683e-4020-8f8a-c2d6e5c3bca8 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:53:01.724781 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-6256a97e-683e-4020-8f8a-c2d6e5c3bca8 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] [instance: 39e14280-8730-41d3-993e-a158f0029386] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:53:01.731149 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-6256a97e-683e-4020-8f8a-c2d6e5c3bca8 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:53:01.731783 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-6256a97e-683e-4020-8f8a-c2d6e5c3bca8 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:53:01.732735 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-6256a97e-683e-4020-8f8a-c2d6e5c3bca8 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:53:01.733444 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-6256a97e-683e-4020-8f8a-c2d6e5c3bca8 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:53:01.907048 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-6256a97e-683e-4020-8f8a-c2d6e5c3bca8 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90033e5e8e634b699bf050e36519f8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8112a5759c444c1f94be24ab61bf072f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:53:01.914442 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-6256a97e-683e-4020-8f8a-c2d6e5c3bca8 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] 10.222.0.26 "GET /compute/v2.1/servers/39e14280-8730-41d3-993e-a158f0029386" status: 200 len: 1522 microversion: 2.1 time: 0.194319 Mar 05 02:53:01.915009 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 64/124] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:53:01 2022] GET /compute/v2.1/servers/39e14280-8730-41d3-993e-a158f0029386 => generated 1522 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 02:53:02.418791 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-faeb0c09-8f55-4b2d-9031-62431370c7ab tempest-DeleteServersTestJSON-1135736220 tempest-DeleteServersTestJSON-1135736220-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:53:02.419277 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-faeb0c09-8f55-4b2d-9031-62431370c7ab tempest-DeleteServersTestJSON-1135736220 tempest-DeleteServersTestJSON-1135736220-project] [instance: e848196a-c1b4-4e17-a748-aa877bce4650] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:53:02.426199 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-faeb0c09-8f55-4b2d-9031-62431370c7ab tempest-DeleteServersTestJSON-1135736220 tempest-DeleteServersTestJSON-1135736220-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:53:02.426717 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-faeb0c09-8f55-4b2d-9031-62431370c7ab tempest-DeleteServersTestJSON-1135736220 tempest-DeleteServersTestJSON-1135736220-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:53:02.427670 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-faeb0c09-8f55-4b2d-9031-62431370c7ab tempest-DeleteServersTestJSON-1135736220 tempest-DeleteServersTestJSON-1135736220-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:53:02.428117 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-faeb0c09-8f55-4b2d-9031-62431370c7ab tempest-DeleteServersTestJSON-1135736220 tempest-DeleteServersTestJSON-1135736220-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:53:02.441884 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.wsgi [None req-faeb0c09-8f55-4b2d-9031-62431370c7ab tempest-DeleteServersTestJSON-1135736220 tempest-DeleteServersTestJSON-1135736220-project] HTTP exception thrown: Instance e848196a-c1b4-4e17-a748-aa877bce4650 could not be found. Mar 05 02:53:02.442505 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-faeb0c09-8f55-4b2d-9031-62431370c7ab tempest-DeleteServersTestJSON-1135736220 tempest-DeleteServersTestJSON-1135736220-project] Returning 404 to user: Instance e848196a-c1b4-4e17-a748-aa877bce4650 could not be found. {{(pid=123545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 02:53:02.443314 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-faeb0c09-8f55-4b2d-9031-62431370c7ab tempest-DeleteServersTestJSON-1135736220 tempest-DeleteServersTestJSON-1135736220-project] 10.222.0.26 "DELETE /compute/v2.1/servers/e848196a-c1b4-4e17-a748-aa877bce4650" status: 404 len: 111 microversion: 2.1 time: 0.028478 Mar 05 02:53:02.444054 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 61/125] 10.222.0.26 () {58 vars in 1238 bytes} [Sat Mar 5 02:53:02 2022] DELETE /compute/v2.1/servers/e848196a-c1b4-4e17-a748-aa877bce4650 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 05 02:53:02.452041 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-0e5a65cd-83fa-4a1f-a177-369a29e9e10d tempest-DeleteServersTestJSON-1135736220 tempest-DeleteServersTestJSON-1135736220-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:53:02.452682 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-0e5a65cd-83fa-4a1f-a177-369a29e9e10d tempest-DeleteServersTestJSON-1135736220 tempest-DeleteServersTestJSON-1135736220-project] [instance: e848196a-c1b4-4e17-a748-aa877bce4650] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:53:02.458945 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-0e5a65cd-83fa-4a1f-a177-369a29e9e10d tempest-DeleteServersTestJSON-1135736220 tempest-DeleteServersTestJSON-1135736220-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:53:02.459581 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-0e5a65cd-83fa-4a1f-a177-369a29e9e10d tempest-DeleteServersTestJSON-1135736220 tempest-DeleteServersTestJSON-1135736220-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:53:02.460536 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-0e5a65cd-83fa-4a1f-a177-369a29e9e10d tempest-DeleteServersTestJSON-1135736220 tempest-DeleteServersTestJSON-1135736220-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:53:02.461163 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-0e5a65cd-83fa-4a1f-a177-369a29e9e10d tempest-DeleteServersTestJSON-1135736220 tempest-DeleteServersTestJSON-1135736220-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:53:02.475792 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.wsgi [None req-0e5a65cd-83fa-4a1f-a177-369a29e9e10d tempest-DeleteServersTestJSON-1135736220 tempest-DeleteServersTestJSON-1135736220-project] HTTP exception thrown: Instance e848196a-c1b4-4e17-a748-aa877bce4650 could not be found. Mar 05 02:53:02.476650 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-0e5a65cd-83fa-4a1f-a177-369a29e9e10d tempest-DeleteServersTestJSON-1135736220 tempest-DeleteServersTestJSON-1135736220-project] Returning 404 to user: Instance e848196a-c1b4-4e17-a748-aa877bce4650 could not be found. {{(pid=123546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 02:53:02.477471 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-0e5a65cd-83fa-4a1f-a177-369a29e9e10d tempest-DeleteServersTestJSON-1135736220 tempest-DeleteServersTestJSON-1135736220-project] 10.222.0.26 "GET /compute/v2.1/servers/e848196a-c1b4-4e17-a748-aa877bce4650" status: 404 len: 111 microversion: 2.1 time: 0.029277 Mar 05 02:53:02.478099 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 65/126] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:53:02 2022] GET /compute/v2.1/servers/e848196a-c1b4-4e17-a748-aa877bce4650 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 05 02:53:02.931876 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-b1ac7735-239b-44da-b82a-9f3ab23c41d9 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:53:02.932760 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-b1ac7735-239b-44da-b82a-9f3ab23c41d9 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] [instance: 39e14280-8730-41d3-993e-a158f0029386] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:53:02.939753 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-b1ac7735-239b-44da-b82a-9f3ab23c41d9 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:53:02.940522 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-b1ac7735-239b-44da-b82a-9f3ab23c41d9 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:53:02.941544 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-b1ac7735-239b-44da-b82a-9f3ab23c41d9 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:53:02.942194 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-b1ac7735-239b-44da-b82a-9f3ab23c41d9 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:53:03.399030 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-b1ac7735-239b-44da-b82a-9f3ab23c41d9 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90033e5e8e634b699bf050e36519f8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8112a5759c444c1f94be24ab61bf072f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:53:03.410317 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-b1ac7735-239b-44da-b82a-9f3ab23c41d9 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] 10.222.0.26 "GET /compute/v2.1/servers/39e14280-8730-41d3-993e-a158f0029386" status: 200 len: 1522 microversion: 2.1 time: 0.482685 Mar 05 02:53:03.410943 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 62/127] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:53:02 2022] GET /compute/v2.1/servers/39e14280-8730-41d3-993e-a158f0029386 => generated 1522 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 02:53:04.429075 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-571fbf26-fe73-436e-b790-c1500c53a16c tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:53:04.429702 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-571fbf26-fe73-436e-b790-c1500c53a16c tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] [instance: 39e14280-8730-41d3-993e-a158f0029386] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:53:04.436573 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-571fbf26-fe73-436e-b790-c1500c53a16c tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:53:04.437125 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-571fbf26-fe73-436e-b790-c1500c53a16c tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:53:04.438325 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-571fbf26-fe73-436e-b790-c1500c53a16c tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:53:04.438773 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-571fbf26-fe73-436e-b790-c1500c53a16c tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:53:04.579896 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-571fbf26-fe73-436e-b790-c1500c53a16c tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90033e5e8e634b699bf050e36519f8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8112a5759c444c1f94be24ab61bf072f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:53:04.587361 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-571fbf26-fe73-436e-b790-c1500c53a16c tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] 10.222.0.26 "GET /compute/v2.1/servers/39e14280-8730-41d3-993e-a158f0029386" status: 200 len: 1522 microversion: 2.1 time: 0.162683 Mar 05 02:53:04.587939 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 66/128] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:53:04 2022] GET /compute/v2.1/servers/39e14280-8730-41d3-993e-a158f0029386 => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 02:53:05.271274 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-b3cc4596-94b4-406b-bb9e-01b73b6806bc tempest-VolumesNegativeTest-707413861 tempest-VolumesNegativeTest-707413861-project] Action: 'create', calling method: .version_select at 0x7f3f6206daf0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-772934155", "metadata": {"Type": "work"}}} {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 02:53:05.273390 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-b3cc4596-94b4-406b-bb9e-01b73b6806bc tempest-VolumesNegativeTest-707413861 tempest-VolumesNegativeTest-707413861-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=123545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 02:53:05.274236 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-b3cc4596-94b4-406b-bb9e-01b73b6806bc tempest-VolumesNegativeTest-707413861 tempest-VolumesNegativeTest-707413861-project] 10.222.0.26 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.131099 Mar 05 02:53:05.274940 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 63/129] 10.222.0.26 () {60 vars in 1155 bytes} [Sat Mar 5 02:53:05 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 132 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Mar 05 02:53:05.286176 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-c26b3cb4-6fab-4277-9981-7623dd17a4f4 tempest-VolumesNegativeTest-707413861 tempest-VolumesNegativeTest-707413861-project] Action: 'create', calling method: .version_select at 0x7f3f628b58b0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-2114288174", "metadata": {"Type": "work"}}} {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 02:53:05.287632 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-c26b3cb4-6fab-4277-9981-7623dd17a4f4 tempest-VolumesNegativeTest-707413861 tempest-VolumesNegativeTest-707413861-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=123546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 02:53:05.288530 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-c26b3cb4-6fab-4277-9981-7623dd17a4f4 tempest-VolumesNegativeTest-707413861 tempest-VolumesNegativeTest-707413861-project] 10.222.0.26 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.008454 Mar 05 02:53:05.293771 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 67/130] 10.222.0.26 () {60 vars in 1155 bytes} [Sat Mar 5 02:53:05 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 14 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Mar 05 02:53:05.298662 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-c14272c9-cb17-4c47-a1df-cd59ffb62a74 tempest-VolumesNegativeTest-707413861 tempest-VolumesNegativeTest-707413861-project] Action: 'create', calling method: .version_select at 0x7f3f644f9160>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1799311791", "metadata": {"Type": "work"}}} {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 02:53:05.300498 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-c14272c9-cb17-4c47-a1df-cd59ffb62a74 tempest-VolumesNegativeTest-707413861 tempest-VolumesNegativeTest-707413861-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=123545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 02:53:05.301776 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-c14272c9-cb17-4c47-a1df-cd59ffb62a74 tempest-VolumesNegativeTest-707413861 tempest-VolumesNegativeTest-707413861-project] 10.222.0.26 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.007752 Mar 05 02:53:05.303051 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 64/131] 10.222.0.26 () {60 vars in 1155 bytes} [Sat Mar 5 02:53:05 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 9 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Mar 05 02:53:05.311593 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-9c76da5e-d45e-4add-b14b-19dd7584f15f tempest-VolumesNegativeTest-707413861 tempest-VolumesNegativeTest-707413861-project] Calling method '.version_select at 0x7f3f62a17c10>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:53:05.341195 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.wsgi [None req-9c76da5e-d45e-4add-b14b-19dd7584f15f tempest-VolumesNegativeTest-707413861 tempest-VolumesNegativeTest-707413861-project] HTTP exception thrown: Volume tempest-invalid-279122180 could not be found. Mar 05 02:53:05.341929 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-9c76da5e-d45e-4add-b14b-19dd7584f15f tempest-VolumesNegativeTest-707413861 tempest-VolumesNegativeTest-707413861-project] Returning 404 to user: Volume tempest-invalid-279122180 could not be found. {{(pid=123546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 02:53:05.344614 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-9c76da5e-d45e-4add-b14b-19dd7584f15f tempest-VolumesNegativeTest-707413861 tempest-VolumesNegativeTest-707413861-project] 10.222.0.26 "DELETE /compute/v2.1/os-volumes/tempest-invalid-279122180" status: 404 len: 98 microversion: 2.1 time: 0.035405 Mar 05 02:53:05.345431 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 68/132] 10.222.0.26 () {58 vars in 1214 bytes} [Sat Mar 5 02:53:05 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-279122180 => generated 98 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Mar 05 02:53:05.355719 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-169fc4e7-0622-4fe4-a2ca-bac85dc1f094 tempest-VolumesNegativeTest-707413861 tempest-VolumesNegativeTest-707413861-project] 10.222.0.26 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.005196 Mar 05 02:53:05.356413 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 65/133] 10.222.0.26 () {58 vars in 1139 bytes} [Sat Mar 5 02:53:05 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 7 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Mar 05 02:53:05.365636 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-79dc0f08-4885-45c8-9c8e-7c2158257d5b tempest-VolumesNegativeTest-707413861 tempest-VolumesNegativeTest-707413861-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003749 Mar 05 02:53:05.366319 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 69/134] 10.222.0.26 () {58 vars in 1136 bytes} [Sat Mar 5 02:53:05 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Mar 05 02:53:05.375186 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-5789e2f6-b398-43fa-b535-e07015f88274 tempest-VolumesNegativeTest-707413861 tempest-VolumesNegativeTest-707413861-project] Calling method '.version_select at 0x7f3f62022160>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:53:05.403010 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.wsgi [None req-5789e2f6-b398-43fa-b535-e07015f88274 tempest-VolumesNegativeTest-707413861 tempest-VolumesNegativeTest-707413861-project] HTTP exception thrown: Volume fc139dcf-b543-4824-8022-22d84103cc80 could not be found. Mar 05 02:53:05.403606 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-5789e2f6-b398-43fa-b535-e07015f88274 tempest-VolumesNegativeTest-707413861 tempest-VolumesNegativeTest-707413861-project] Returning 404 to user: Volume fc139dcf-b543-4824-8022-22d84103cc80 could not be found. {{(pid=123545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 02:53:05.404431 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-5789e2f6-b398-43fa-b535-e07015f88274 tempest-VolumesNegativeTest-707413861 tempest-VolumesNegativeTest-707413861-project] 10.222.0.26 "DELETE /compute/v2.1/os-volumes/fc139dcf-b543-4824-8022-22d84103cc80" status: 404 len: 109 microversion: 2.1 time: 0.033141 Mar 05 02:53:05.405012 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 66/135] 10.222.0.26 () {58 vars in 1247 bytes} [Sat Mar 5 02:53:05 2022] DELETE /compute/v2.1/os-volumes/fc139dcf-b543-4824-8022-22d84103cc80 => generated 109 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 05 02:53:05.414951 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-14f167b8-09b5-44ba-afcc-1311e6709a1e tempest-VolumesNegativeTest-707413861 tempest-VolumesNegativeTest-707413861-project] Calling method '.version_select at 0x7f3f62859f70>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:53:05.479390 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.wsgi [None req-14f167b8-09b5-44ba-afcc-1311e6709a1e tempest-VolumesNegativeTest-707413861 tempest-VolumesNegativeTest-707413861-project] HTTP exception thrown: Volume a0c695b7-31e2-4a99-aa83-30c2382138c9 could not be found. Mar 05 02:53:05.480232 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-14f167b8-09b5-44ba-afcc-1311e6709a1e tempest-VolumesNegativeTest-707413861 tempest-VolumesNegativeTest-707413861-project] Returning 404 to user: Volume a0c695b7-31e2-4a99-aa83-30c2382138c9 could not be found. {{(pid=123546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 02:53:05.481047 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-14f167b8-09b5-44ba-afcc-1311e6709a1e tempest-VolumesNegativeTest-707413861 tempest-VolumesNegativeTest-707413861-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/a0c695b7-31e2-4a99-aa83-30c2382138c9" status: 404 len: 109 microversion: 2.1 time: 0.069958 Mar 05 02:53:05.481593 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 70/136] 10.222.0.26 () {58 vars in 1244 bytes} [Sat Mar 5 02:53:05 2022] GET /compute/v2.1/os-volumes/a0c695b7-31e2-4a99-aa83-30c2382138c9 => generated 109 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 05 02:53:05.605107 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-8a3163a4-30bf-41bc-861c-8fffe88f5102 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:53:05.606097 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-8a3163a4-30bf-41bc-861c-8fffe88f5102 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] [instance: 39e14280-8730-41d3-993e-a158f0029386] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:53:05.625725 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-8a3163a4-30bf-41bc-861c-8fffe88f5102 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:53:05.626730 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-8a3163a4-30bf-41bc-861c-8fffe88f5102 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:53:05.627810 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-8a3163a4-30bf-41bc-861c-8fffe88f5102 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:53:05.628250 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-8a3163a4-30bf-41bc-861c-8fffe88f5102 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:53:05.823683 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-8a3163a4-30bf-41bc-861c-8fffe88f5102 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90033e5e8e634b699bf050e36519f8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8112a5759c444c1f94be24ab61bf072f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:53:05.835158 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-8a3163a4-30bf-41bc-861c-8fffe88f5102 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] 10.222.0.26 "GET /compute/v2.1/servers/39e14280-8730-41d3-993e-a158f0029386" status: 200 len: 1522 microversion: 2.1 time: 0.235000 Mar 05 02:53:05.835738 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 67/137] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:53:05 2022] GET /compute/v2.1/servers/39e14280-8730-41d3-993e-a158f0029386 => generated 1522 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 02:53:06.853331 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-d4e07f75-c5c5-41c6-b5f4-de2646c78cd1 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:53:06.854008 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-d4e07f75-c5c5-41c6-b5f4-de2646c78cd1 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] [instance: 39e14280-8730-41d3-993e-a158f0029386] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:53:06.863511 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-d4e07f75-c5c5-41c6-b5f4-de2646c78cd1 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:53:06.863837 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-d4e07f75-c5c5-41c6-b5f4-de2646c78cd1 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:53:06.864518 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-d4e07f75-c5c5-41c6-b5f4-de2646c78cd1 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:53:06.864976 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-d4e07f75-c5c5-41c6-b5f4-de2646c78cd1 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:53:07.020191 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-d4e07f75-c5c5-41c6-b5f4-de2646c78cd1 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90033e5e8e634b699bf050e36519f8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8112a5759c444c1f94be24ab61bf072f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:53:07.027614 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-d4e07f75-c5c5-41c6-b5f4-de2646c78cd1 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] 10.222.0.26 "GET /compute/v2.1/servers/39e14280-8730-41d3-993e-a158f0029386" status: 200 len: 1522 microversion: 2.1 time: 0.178715 Mar 05 02:53:07.028374 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 71/138] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:53:06 2022] GET /compute/v2.1/servers/39e14280-8730-41d3-993e-a158f0029386 => generated 1522 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 02:53:08.046124 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-ed7f6fa8-cde2-4239-b4e9-58a144ff44ff tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:53:08.046808 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-ed7f6fa8-cde2-4239-b4e9-58a144ff44ff tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] [instance: 39e14280-8730-41d3-993e-a158f0029386] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:53:08.055752 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-ed7f6fa8-cde2-4239-b4e9-58a144ff44ff tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:53:08.056216 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-ed7f6fa8-cde2-4239-b4e9-58a144ff44ff tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:53:08.057173 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-ed7f6fa8-cde2-4239-b4e9-58a144ff44ff tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:53:08.057620 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-ed7f6fa8-cde2-4239-b4e9-58a144ff44ff tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:53:08.256427 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-ed7f6fa8-cde2-4239-b4e9-58a144ff44ff tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90033e5e8e634b699bf050e36519f8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8112a5759c444c1f94be24ab61bf072f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:53:08.266499 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-ed7f6fa8-cde2-4239-b4e9-58a144ff44ff tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] 10.222.0.26 "GET /compute/v2.1/servers/39e14280-8730-41d3-993e-a158f0029386" status: 200 len: 1522 microversion: 2.1 time: 0.224167 Mar 05 02:53:08.274934 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 68/139] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:53:08 2022] GET /compute/v2.1/servers/39e14280-8730-41d3-993e-a158f0029386 => generated 1522 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 02:53:09.285742 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-1796c279-4161-4868-a677-432bd6863ff7 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:53:09.286838 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-1796c279-4161-4868-a677-432bd6863ff7 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] [instance: 39e14280-8730-41d3-993e-a158f0029386] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:53:09.299350 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-1796c279-4161-4868-a677-432bd6863ff7 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:53:09.300734 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-1796c279-4161-4868-a677-432bd6863ff7 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:53:09.302144 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-1796c279-4161-4868-a677-432bd6863ff7 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:53:09.302834 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-1796c279-4161-4868-a677-432bd6863ff7 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:53:09.564838 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-1796c279-4161-4868-a677-432bd6863ff7 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90033e5e8e634b699bf050e36519f8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8112a5759c444c1f94be24ab61bf072f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:53:09.572871 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-1796c279-4161-4868-a677-432bd6863ff7 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] 10.222.0.26 "GET /compute/v2.1/servers/39e14280-8730-41d3-993e-a158f0029386" status: 200 len: 1522 microversion: 2.1 time: 0.292541 Mar 05 02:53:09.573550 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 72/140] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:53:09 2022] GET /compute/v2.1/servers/39e14280-8730-41d3-993e-a158f0029386 => generated 1522 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 02:53:10.590796 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-dcf49332-f511-449d-ae1e-4738daee4d41 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:53:10.591400 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-dcf49332-f511-449d-ae1e-4738daee4d41 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] [instance: 39e14280-8730-41d3-993e-a158f0029386] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:53:10.597146 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-dcf49332-f511-449d-ae1e-4738daee4d41 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:53:10.597588 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-dcf49332-f511-449d-ae1e-4738daee4d41 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:53:10.598379 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-dcf49332-f511-449d-ae1e-4738daee4d41 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:53:10.598809 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-dcf49332-f511-449d-ae1e-4738daee4d41 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:53:10.766677 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-dcf49332-f511-449d-ae1e-4738daee4d41 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90033e5e8e634b699bf050e36519f8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8112a5759c444c1f94be24ab61bf072f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:53:10.774623 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-dcf49332-f511-449d-ae1e-4738daee4d41 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] 10.222.0.26 "GET /compute/v2.1/servers/39e14280-8730-41d3-993e-a158f0029386" status: 200 len: 1522 microversion: 2.1 time: 0.187495 Mar 05 02:53:10.775203 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 69/141] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:53:10 2022] GET /compute/v2.1/servers/39e14280-8730-41d3-993e-a158f0029386 => generated 1522 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 02:53:11.793036 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-6c03d508-9b35-4c72-83f9-5b9faf613387 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:53:11.794534 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-6c03d508-9b35-4c72-83f9-5b9faf613387 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] [instance: 39e14280-8730-41d3-993e-a158f0029386] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:53:11.811627 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-6c03d508-9b35-4c72-83f9-5b9faf613387 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:53:11.812922 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-6c03d508-9b35-4c72-83f9-5b9faf613387 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:53:11.814144 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-6c03d508-9b35-4c72-83f9-5b9faf613387 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:53:11.814732 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-6c03d508-9b35-4c72-83f9-5b9faf613387 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:53:12.056823 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-6c03d508-9b35-4c72-83f9-5b9faf613387 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90033e5e8e634b699bf050e36519f8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8112a5759c444c1f94be24ab61bf072f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:53:12.066162 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-6c03d508-9b35-4c72-83f9-5b9faf613387 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] 10.222.0.26 "GET /compute/v2.1/servers/39e14280-8730-41d3-993e-a158f0029386" status: 200 len: 1522 microversion: 2.1 time: 0.277682 Mar 05 02:53:12.069060 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 73/142] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:53:11 2022] GET /compute/v2.1/servers/39e14280-8730-41d3-993e-a158f0029386 => generated 1522 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 02:53:13.086264 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-9c0cd8a6-eb0c-4012-986c-a13bb5fcf843 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:53:13.086939 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-9c0cd8a6-eb0c-4012-986c-a13bb5fcf843 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] [instance: 39e14280-8730-41d3-993e-a158f0029386] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:53:13.096410 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-9c0cd8a6-eb0c-4012-986c-a13bb5fcf843 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:53:13.096876 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-9c0cd8a6-eb0c-4012-986c-a13bb5fcf843 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:53:13.097753 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-9c0cd8a6-eb0c-4012-986c-a13bb5fcf843 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:53:13.098136 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-9c0cd8a6-eb0c-4012-986c-a13bb5fcf843 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:53:13.254193 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-9c0cd8a6-eb0c-4012-986c-a13bb5fcf843 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90033e5e8e634b699bf050e36519f8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8112a5759c444c1f94be24ab61bf072f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:53:13.263923 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-9c0cd8a6-eb0c-4012-986c-a13bb5fcf843 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] 10.222.0.26 "GET /compute/v2.1/servers/39e14280-8730-41d3-993e-a158f0029386" status: 200 len: 1522 microversion: 2.1 time: 0.181668 Mar 05 02:53:13.264943 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 70/143] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:53:13 2022] GET /compute/v2.1/servers/39e14280-8730-41d3-993e-a158f0029386 => generated 1522 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 02:53:14.280515 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-ce19f5d2-eaa4-4b1d-bd92-94d831c91c7e tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:53:14.281668 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-ce19f5d2-eaa4-4b1d-bd92-94d831c91c7e tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] [instance: 39e14280-8730-41d3-993e-a158f0029386] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:53:14.291470 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-ce19f5d2-eaa4-4b1d-bd92-94d831c91c7e tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:53:14.292301 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-ce19f5d2-eaa4-4b1d-bd92-94d831c91c7e tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:53:14.293740 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-ce19f5d2-eaa4-4b1d-bd92-94d831c91c7e tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:53:14.294467 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-ce19f5d2-eaa4-4b1d-bd92-94d831c91c7e tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:53:14.443274 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-ce19f5d2-eaa4-4b1d-bd92-94d831c91c7e tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90033e5e8e634b699bf050e36519f8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8112a5759c444c1f94be24ab61bf072f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:53:14.451901 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-ce19f5d2-eaa4-4b1d-bd92-94d831c91c7e tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] 10.222.0.26 "GET /compute/v2.1/servers/39e14280-8730-41d3-993e-a158f0029386" status: 200 len: 1522 microversion: 2.1 time: 0.175156 Mar 05 02:53:14.454144 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 74/144] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:53:14 2022] GET /compute/v2.1/servers/39e14280-8730-41d3-993e-a158f0029386 => generated 1522 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 02:53:15.468906 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-49ec1b0a-8755-492b-9361-e04d35bd0068 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:53:15.469925 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-49ec1b0a-8755-492b-9361-e04d35bd0068 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] [instance: 39e14280-8730-41d3-993e-a158f0029386] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:53:15.476684 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-49ec1b0a-8755-492b-9361-e04d35bd0068 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:53:15.477274 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-49ec1b0a-8755-492b-9361-e04d35bd0068 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:53:15.478440 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-49ec1b0a-8755-492b-9361-e04d35bd0068 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:53:15.479068 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-49ec1b0a-8755-492b-9361-e04d35bd0068 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:53:15.683889 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-49ec1b0a-8755-492b-9361-e04d35bd0068 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90033e5e8e634b699bf050e36519f8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8112a5759c444c1f94be24ab61bf072f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:53:15.692475 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-49ec1b0a-8755-492b-9361-e04d35bd0068 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] 10.222.0.26 "GET /compute/v2.1/servers/39e14280-8730-41d3-993e-a158f0029386" status: 200 len: 1522 microversion: 2.1 time: 0.227827 Mar 05 02:53:15.693098 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 71/145] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:53:15 2022] GET /compute/v2.1/servers/39e14280-8730-41d3-993e-a158f0029386 => generated 1522 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 02:53:16.709091 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-5456ab6d-3957-4da4-96dd-7381f5101123 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:53:16.709787 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-5456ab6d-3957-4da4-96dd-7381f5101123 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] [instance: 39e14280-8730-41d3-993e-a158f0029386] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:53:16.716425 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-5456ab6d-3957-4da4-96dd-7381f5101123 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:53:16.716975 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-5456ab6d-3957-4da4-96dd-7381f5101123 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:53:16.717811 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-5456ab6d-3957-4da4-96dd-7381f5101123 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:53:16.718619 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-5456ab6d-3957-4da4-96dd-7381f5101123 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:53:16.867387 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-5456ab6d-3957-4da4-96dd-7381f5101123 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90033e5e8e634b699bf050e36519f8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8112a5759c444c1f94be24ab61bf072f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:53:16.875894 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-5456ab6d-3957-4da4-96dd-7381f5101123 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] 10.222.0.26 "GET /compute/v2.1/servers/39e14280-8730-41d3-993e-a158f0029386" status: 200 len: 1522 microversion: 2.1 time: 0.170694 Mar 05 02:53:16.876596 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 75/146] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:53:16 2022] GET /compute/v2.1/servers/39e14280-8730-41d3-993e-a158f0029386 => generated 1522 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 02:53:17.892382 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-2c802237-1bbe-4932-a17e-0faed750fa34 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:53:17.893074 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-2c802237-1bbe-4932-a17e-0faed750fa34 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] [instance: 39e14280-8730-41d3-993e-a158f0029386] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:53:17.900526 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-2c802237-1bbe-4932-a17e-0faed750fa34 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:53:17.900686 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-2c802237-1bbe-4932-a17e-0faed750fa34 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:53:17.901555 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-2c802237-1bbe-4932-a17e-0faed750fa34 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:53:17.901919 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-2c802237-1bbe-4932-a17e-0faed750fa34 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:53:18.042487 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-2c802237-1bbe-4932-a17e-0faed750fa34 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90033e5e8e634b699bf050e36519f8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8112a5759c444c1f94be24ab61bf072f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:53:18.049750 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-2c802237-1bbe-4932-a17e-0faed750fa34 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] 10.222.0.26 "GET /compute/v2.1/servers/39e14280-8730-41d3-993e-a158f0029386" status: 200 len: 1522 microversion: 2.1 time: 0.161442 Mar 05 02:53:18.050359 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 72/147] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:53:17 2022] GET /compute/v2.1/servers/39e14280-8730-41d3-993e-a158f0029386 => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 02:53:19.066671 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-b44ac005-f3b6-43f4-b907-2bfb6ed63073 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:53:19.067290 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-b44ac005-f3b6-43f4-b907-2bfb6ed63073 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] [instance: 39e14280-8730-41d3-993e-a158f0029386] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:53:19.073475 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-b44ac005-f3b6-43f4-b907-2bfb6ed63073 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:53:19.073933 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-b44ac005-f3b6-43f4-b907-2bfb6ed63073 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:53:19.074737 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-b44ac005-f3b6-43f4-b907-2bfb6ed63073 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:53:19.075179 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-b44ac005-f3b6-43f4-b907-2bfb6ed63073 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:53:19.220529 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-b44ac005-f3b6-43f4-b907-2bfb6ed63073 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90033e5e8e634b699bf050e36519f8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8112a5759c444c1f94be24ab61bf072f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:53:19.228014 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-b44ac005-f3b6-43f4-b907-2bfb6ed63073 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] 10.222.0.26 "GET /compute/v2.1/servers/39e14280-8730-41d3-993e-a158f0029386" status: 200 len: 1522 microversion: 2.1 time: 0.165900 Mar 05 02:53:19.228581 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 76/148] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:53:19 2022] GET /compute/v2.1/servers/39e14280-8730-41d3-993e-a158f0029386 => generated 1522 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 02:53:20.246291 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-24873c0a-4b50-4b0b-a22c-3673af3558b5 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:53:20.246907 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-24873c0a-4b50-4b0b-a22c-3673af3558b5 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] [instance: 39e14280-8730-41d3-993e-a158f0029386] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:53:20.252769 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-24873c0a-4b50-4b0b-a22c-3673af3558b5 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:53:20.253223 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-24873c0a-4b50-4b0b-a22c-3673af3558b5 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:53:20.254017 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-24873c0a-4b50-4b0b-a22c-3673af3558b5 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:53:20.254458 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-24873c0a-4b50-4b0b-a22c-3673af3558b5 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:53:20.383657 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-24873c0a-4b50-4b0b-a22c-3673af3558b5 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90033e5e8e634b699bf050e36519f8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8112a5759c444c1f94be24ab61bf072f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:53:20.392002 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-24873c0a-4b50-4b0b-a22c-3673af3558b5 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] 10.222.0.26 "GET /compute/v2.1/servers/39e14280-8730-41d3-993e-a158f0029386" status: 200 len: 1522 microversion: 2.1 time: 0.149522 Mar 05 02:53:20.392576 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 73/149] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:53:20 2022] GET /compute/v2.1/servers/39e14280-8730-41d3-993e-a158f0029386 => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 02:53:21.408710 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-77641b3d-bf0e-49d8-b667-e2750f6d0d16 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:53:21.409309 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-77641b3d-bf0e-49d8-b667-e2750f6d0d16 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] [instance: 39e14280-8730-41d3-993e-a158f0029386] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:53:21.415560 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-77641b3d-bf0e-49d8-b667-e2750f6d0d16 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:53:21.416009 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-77641b3d-bf0e-49d8-b667-e2750f6d0d16 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:53:21.416777 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-77641b3d-bf0e-49d8-b667-e2750f6d0d16 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:53:21.417214 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-77641b3d-bf0e-49d8-b667-e2750f6d0d16 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:53:21.548746 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-77641b3d-bf0e-49d8-b667-e2750f6d0d16 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90033e5e8e634b699bf050e36519f8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8112a5759c444c1f94be24ab61bf072f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:53:21.555917 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-77641b3d-bf0e-49d8-b667-e2750f6d0d16 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] 10.222.0.26 "GET /compute/v2.1/servers/39e14280-8730-41d3-993e-a158f0029386" status: 200 len: 1522 microversion: 2.1 time: 0.151292 Mar 05 02:53:21.556497 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 77/150] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:53:21 2022] GET /compute/v2.1/servers/39e14280-8730-41d3-993e-a158f0029386 => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 02:53:22.572792 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-724ca4d7-8b96-4994-8d2c-930e492a3f2d tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:53:22.573314 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-724ca4d7-8b96-4994-8d2c-930e492a3f2d tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] [instance: 39e14280-8730-41d3-993e-a158f0029386] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:53:22.580246 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-724ca4d7-8b96-4994-8d2c-930e492a3f2d tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:53:22.580694 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-724ca4d7-8b96-4994-8d2c-930e492a3f2d tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:53:22.581471 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-724ca4d7-8b96-4994-8d2c-930e492a3f2d tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:53:22.581907 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-724ca4d7-8b96-4994-8d2c-930e492a3f2d tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:53:22.731874 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-724ca4d7-8b96-4994-8d2c-930e492a3f2d tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90033e5e8e634b699bf050e36519f8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8112a5759c444c1f94be24ab61bf072f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:53:22.739972 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-724ca4d7-8b96-4994-8d2c-930e492a3f2d tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] 10.222.0.26 "GET /compute/v2.1/servers/39e14280-8730-41d3-993e-a158f0029386" status: 200 len: 1522 microversion: 2.1 time: 0.171111 Mar 05 02:53:22.740551 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 74/151] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:53:22 2022] GET /compute/v2.1/servers/39e14280-8730-41d3-993e-a158f0029386 => generated 1522 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 02:53:23.757466 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-d3a843ac-56e7-4bd7-8a65-0104a85141ad tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:53:23.758423 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-d3a843ac-56e7-4bd7-8a65-0104a85141ad tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] [instance: 39e14280-8730-41d3-993e-a158f0029386] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:53:23.764844 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-d3a843ac-56e7-4bd7-8a65-0104a85141ad tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:53:23.765909 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-d3a843ac-56e7-4bd7-8a65-0104a85141ad tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:53:23.766701 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-d3a843ac-56e7-4bd7-8a65-0104a85141ad tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:53:23.767129 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-d3a843ac-56e7-4bd7-8a65-0104a85141ad tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:53:23.895954 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-d3a843ac-56e7-4bd7-8a65-0104a85141ad tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90033e5e8e634b699bf050e36519f8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8112a5759c444c1f94be24ab61bf072f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:53:23.903576 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-d3a843ac-56e7-4bd7-8a65-0104a85141ad tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] 10.222.0.26 "GET /compute/v2.1/servers/39e14280-8730-41d3-993e-a158f0029386" status: 200 len: 1522 microversion: 2.1 time: 0.150550 Mar 05 02:53:23.904131 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 78/152] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:53:23 2022] GET /compute/v2.1/servers/39e14280-8730-41d3-993e-a158f0029386 => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 02:53:24.920262 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-4e12e3fd-d691-4f0a-8b2e-4b91543b2404 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:53:24.920938 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-4e12e3fd-d691-4f0a-8b2e-4b91543b2404 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] [instance: 39e14280-8730-41d3-993e-a158f0029386] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:53:24.926854 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-4e12e3fd-d691-4f0a-8b2e-4b91543b2404 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:53:24.927302 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-4e12e3fd-d691-4f0a-8b2e-4b91543b2404 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:53:24.928078 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-4e12e3fd-d691-4f0a-8b2e-4b91543b2404 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:53:24.928511 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-4e12e3fd-d691-4f0a-8b2e-4b91543b2404 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:53:25.064212 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-4e12e3fd-d691-4f0a-8b2e-4b91543b2404 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90033e5e8e634b699bf050e36519f8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8112a5759c444c1f94be24ab61bf072f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:53:25.071566 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-4e12e3fd-d691-4f0a-8b2e-4b91543b2404 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] 10.222.0.26 "GET /compute/v2.1/servers/39e14280-8730-41d3-993e-a158f0029386" status: 200 len: 1522 microversion: 2.1 time: 0.155138 Mar 05 02:53:25.072173 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 75/153] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:53:24 2022] GET /compute/v2.1/servers/39e14280-8730-41d3-993e-a158f0029386 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 02:53:26.088408 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-3bfe669b-931d-42b3-8cd8-f3129fb70edc tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:53:26.089011 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-3bfe669b-931d-42b3-8cd8-f3129fb70edc tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] [instance: 39e14280-8730-41d3-993e-a158f0029386] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:53:26.097484 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-3bfe669b-931d-42b3-8cd8-f3129fb70edc tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:53:26.098025 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-3bfe669b-931d-42b3-8cd8-f3129fb70edc tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:53:26.099288 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-3bfe669b-931d-42b3-8cd8-f3129fb70edc tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:53:26.099841 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-3bfe669b-931d-42b3-8cd8-f3129fb70edc tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:53:26.235022 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-3bfe669b-931d-42b3-8cd8-f3129fb70edc tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90033e5e8e634b699bf050e36519f8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8112a5759c444c1f94be24ab61bf072f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:53:26.242311 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-3bfe669b-931d-42b3-8cd8-f3129fb70edc tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] 10.222.0.26 "GET /compute/v2.1/servers/39e14280-8730-41d3-993e-a158f0029386" status: 200 len: 1522 microversion: 2.1 time: 0.157597 Mar 05 02:53:26.245990 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 79/154] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:53:26 2022] GET /compute/v2.1/servers/39e14280-8730-41d3-993e-a158f0029386 => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 02:53:27.258667 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-f1a4c5d0-feca-4012-8e31-5711b00eaab4 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:53:27.259272 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-f1a4c5d0-feca-4012-8e31-5711b00eaab4 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] [instance: 39e14280-8730-41d3-993e-a158f0029386] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:53:27.265388 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-f1a4c5d0-feca-4012-8e31-5711b00eaab4 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:53:27.265831 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-f1a4c5d0-feca-4012-8e31-5711b00eaab4 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:53:27.266660 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-f1a4c5d0-feca-4012-8e31-5711b00eaab4 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:53:27.267086 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-f1a4c5d0-feca-4012-8e31-5711b00eaab4 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:53:27.398606 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-f1a4c5d0-feca-4012-8e31-5711b00eaab4 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90033e5e8e634b699bf050e36519f8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8112a5759c444c1f94be24ab61bf072f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:53:27.407042 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-f1a4c5d0-feca-4012-8e31-5711b00eaab4 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] 10.222.0.26 "GET /compute/v2.1/servers/39e14280-8730-41d3-993e-a158f0029386" status: 200 len: 1522 microversion: 2.1 time: 0.150954 Mar 05 02:53:27.407603 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 76/155] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:53:27 2022] GET /compute/v2.1/servers/39e14280-8730-41d3-993e-a158f0029386 => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 02:53:28.424181 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-e49f2399-b458-4da2-abc4-a17edefb8892 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:53:28.424792 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-e49f2399-b458-4da2-abc4-a17edefb8892 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] [instance: 39e14280-8730-41d3-993e-a158f0029386] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:53:28.431194 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-e49f2399-b458-4da2-abc4-a17edefb8892 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:53:28.431646 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-e49f2399-b458-4da2-abc4-a17edefb8892 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:53:28.432419 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-e49f2399-b458-4da2-abc4-a17edefb8892 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:53:28.432856 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-e49f2399-b458-4da2-abc4-a17edefb8892 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:53:28.567383 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-e49f2399-b458-4da2-abc4-a17edefb8892 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90033e5e8e634b699bf050e36519f8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8112a5759c444c1f94be24ab61bf072f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:53:28.574671 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-e49f2399-b458-4da2-abc4-a17edefb8892 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] 10.222.0.26 "GET /compute/v2.1/servers/39e14280-8730-41d3-993e-a158f0029386" status: 200 len: 1522 microversion: 2.1 time: 0.154973 Mar 05 02:53:28.575547 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 80/156] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:53:28 2022] GET /compute/v2.1/servers/39e14280-8730-41d3-993e-a158f0029386 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 02:53:29.592776 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-4aabcf6a-b785-4bab-9744-fa78571b3bf5 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:53:29.593394 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-4aabcf6a-b785-4bab-9744-fa78571b3bf5 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] [instance: 39e14280-8730-41d3-993e-a158f0029386] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:53:29.599242 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-4aabcf6a-b785-4bab-9744-fa78571b3bf5 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:53:29.599685 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-4aabcf6a-b785-4bab-9744-fa78571b3bf5 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:53:29.600452 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-4aabcf6a-b785-4bab-9744-fa78571b3bf5 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:53:29.600881 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-4aabcf6a-b785-4bab-9744-fa78571b3bf5 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:53:29.742068 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-4aabcf6a-b785-4bab-9744-fa78571b3bf5 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90033e5e8e634b699bf050e36519f8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8112a5759c444c1f94be24ab61bf072f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:53:29.750466 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-4aabcf6a-b785-4bab-9744-fa78571b3bf5 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] 10.222.0.26 "GET /compute/v2.1/servers/39e14280-8730-41d3-993e-a158f0029386" status: 200 len: 1522 microversion: 2.1 time: 0.161332 Mar 05 02:53:29.751054 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 77/157] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:53:29 2022] GET /compute/v2.1/servers/39e14280-8730-41d3-993e-a158f0029386 => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 02:53:30.769107 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-554020db-78b7-42c5-bdf5-8030f857006f tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:53:30.769800 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-554020db-78b7-42c5-bdf5-8030f857006f tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] [instance: 39e14280-8730-41d3-993e-a158f0029386] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:53:30.787070 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-554020db-78b7-42c5-bdf5-8030f857006f tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:53:30.787070 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-554020db-78b7-42c5-bdf5-8030f857006f tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:53:30.795180 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-554020db-78b7-42c5-bdf5-8030f857006f tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:53:30.795180 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-554020db-78b7-42c5-bdf5-8030f857006f tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:53:30.975197 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-554020db-78b7-42c5-bdf5-8030f857006f tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90033e5e8e634b699bf050e36519f8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8112a5759c444c1f94be24ab61bf072f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:53:30.983224 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-554020db-78b7-42c5-bdf5-8030f857006f tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] 10.222.0.26 "GET /compute/v2.1/servers/39e14280-8730-41d3-993e-a158f0029386" status: 200 len: 1522 microversion: 2.1 time: 0.219699 Mar 05 02:53:30.984366 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 81/158] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:53:30 2022] GET /compute/v2.1/servers/39e14280-8730-41d3-993e-a158f0029386 => generated 1522 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 02:53:32.000621 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-14ee2fe4-4243-4e0f-b625-351f644a2115 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:53:32.001223 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-14ee2fe4-4243-4e0f-b625-351f644a2115 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] [instance: 39e14280-8730-41d3-993e-a158f0029386] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:53:32.050560 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-14ee2fe4-4243-4e0f-b625-351f644a2115 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:53:32.079938 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-14ee2fe4-4243-4e0f-b625-351f644a2115 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:53:32.081015 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-14ee2fe4-4243-4e0f-b625-351f644a2115 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:53:32.081466 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-14ee2fe4-4243-4e0f-b625-351f644a2115 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:53:32.458587 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-14ee2fe4-4243-4e0f-b625-351f644a2115 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90033e5e8e634b699bf050e36519f8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8112a5759c444c1f94be24ab61bf072f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:53:32.472766 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-14ee2fe4-4243-4e0f-b625-351f644a2115 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] 10.222.0.26 "GET /compute/v2.1/servers/39e14280-8730-41d3-993e-a158f0029386" status: 200 len: 1522 microversion: 2.1 time: 0.475889 Mar 05 02:53:32.473591 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 78/159] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:53:31 2022] GET /compute/v2.1/servers/39e14280-8730-41d3-993e-a158f0029386 => generated 1522 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 02:53:33.500231 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-ddec71d0-60a6-4dea-a099-193e4f76daf5 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:53:33.500975 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-ddec71d0-60a6-4dea-a099-193e4f76daf5 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] [instance: 39e14280-8730-41d3-993e-a158f0029386] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:53:33.508544 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-ddec71d0-60a6-4dea-a099-193e4f76daf5 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:53:33.509708 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-ddec71d0-60a6-4dea-a099-193e4f76daf5 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:53:33.510685 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-ddec71d0-60a6-4dea-a099-193e4f76daf5 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:53:33.511236 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-ddec71d0-60a6-4dea-a099-193e4f76daf5 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:53:33.656817 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-ddec71d0-60a6-4dea-a099-193e4f76daf5 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90033e5e8e634b699bf050e36519f8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8112a5759c444c1f94be24ab61bf072f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:53:33.664327 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-ddec71d0-60a6-4dea-a099-193e4f76daf5 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] 10.222.0.26 "GET /compute/v2.1/servers/39e14280-8730-41d3-993e-a158f0029386" status: 200 len: 1522 microversion: 2.1 time: 0.176406 Mar 05 02:53:33.664972 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 82/160] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:53:33 2022] GET /compute/v2.1/servers/39e14280-8730-41d3-993e-a158f0029386 => generated 1522 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 02:53:34.681933 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-edb7347c-c7fa-4f85-bfa0-8864b5b68dfa tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:53:34.682647 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-edb7347c-c7fa-4f85-bfa0-8864b5b68dfa tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] [instance: 39e14280-8730-41d3-993e-a158f0029386] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:53:34.689200 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-edb7347c-c7fa-4f85-bfa0-8864b5b68dfa tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:53:34.689649 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-edb7347c-c7fa-4f85-bfa0-8864b5b68dfa tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:53:34.690444 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-edb7347c-c7fa-4f85-bfa0-8864b5b68dfa tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:53:34.690914 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-edb7347c-c7fa-4f85-bfa0-8864b5b68dfa tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:53:34.892460 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-edb7347c-c7fa-4f85-bfa0-8864b5b68dfa tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90033e5e8e634b699bf050e36519f8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8112a5759c444c1f94be24ab61bf072f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:53:34.901009 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-edb7347c-c7fa-4f85-bfa0-8864b5b68dfa tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] 10.222.0.26 "GET /compute/v2.1/servers/39e14280-8730-41d3-993e-a158f0029386" status: 200 len: 1522 microversion: 2.1 time: 0.223118 Mar 05 02:53:34.901591 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 79/161] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:53:34 2022] GET /compute/v2.1/servers/39e14280-8730-41d3-993e-a158f0029386 => generated 1522 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 02:53:35.917665 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-1aa6d053-a3dd-467e-b2a1-95389f8ec9d4 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:53:35.918299 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-1aa6d053-a3dd-467e-b2a1-95389f8ec9d4 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] [instance: 39e14280-8730-41d3-993e-a158f0029386] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:53:35.925427 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-1aa6d053-a3dd-467e-b2a1-95389f8ec9d4 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:53:35.925876 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-1aa6d053-a3dd-467e-b2a1-95389f8ec9d4 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:53:35.926669 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-1aa6d053-a3dd-467e-b2a1-95389f8ec9d4 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:53:35.927107 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-1aa6d053-a3dd-467e-b2a1-95389f8ec9d4 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:53:36.062193 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-1aa6d053-a3dd-467e-b2a1-95389f8ec9d4 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90033e5e8e634b699bf050e36519f8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8112a5759c444c1f94be24ab61bf072f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:53:36.069513 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-1aa6d053-a3dd-467e-b2a1-95389f8ec9d4 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] 10.222.0.26 "GET /compute/v2.1/servers/39e14280-8730-41d3-993e-a158f0029386" status: 200 len: 1522 microversion: 2.1 time: 0.155703 Mar 05 02:53:36.070109 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 83/162] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:53:35 2022] GET /compute/v2.1/servers/39e14280-8730-41d3-993e-a158f0029386 => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 02:53:37.087425 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-83b78606-a204-4a15-903b-e73fbec84402 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:53:37.088181 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-83b78606-a204-4a15-903b-e73fbec84402 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] [instance: 39e14280-8730-41d3-993e-a158f0029386] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:53:37.093869 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-83b78606-a204-4a15-903b-e73fbec84402 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:53:37.094347 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-83b78606-a204-4a15-903b-e73fbec84402 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:53:37.095107 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-83b78606-a204-4a15-903b-e73fbec84402 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:53:37.095567 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-83b78606-a204-4a15-903b-e73fbec84402 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:53:37.257994 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-83b78606-a204-4a15-903b-e73fbec84402 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90033e5e8e634b699bf050e36519f8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8112a5759c444c1f94be24ab61bf072f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:53:37.266809 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-83b78606-a204-4a15-903b-e73fbec84402 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] 10.222.0.26 "GET /compute/v2.1/servers/39e14280-8730-41d3-993e-a158f0029386" status: 200 len: 1502 microversion: 2.1 time: 0.183263 Mar 05 02:53:37.267480 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 80/163] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:53:37 2022] GET /compute/v2.1/servers/39e14280-8730-41d3-993e-a158f0029386 => generated 1502 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 02:53:37.284281 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-6ce5a980-ec65-41f4-930c-9c78c6b6f963 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:53:37.285163 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-6ce5a980-ec65-41f4-930c-9c78c6b6f963 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] [instance: c24fee69-5bf4-40f4-ba18-56aecd12dd96] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:53:37.292892 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-6ce5a980-ec65-41f4-930c-9c78c6b6f963 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:53:37.293351 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-6ce5a980-ec65-41f4-930c-9c78c6b6f963 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:53:37.294164 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-6ce5a980-ec65-41f4-930c-9c78c6b6f963 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:53:37.294606 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-6ce5a980-ec65-41f4-930c-9c78c6b6f963 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:53:37.440125 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-6ce5a980-ec65-41f4-930c-9c78c6b6f963 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90033e5e8e634b699bf050e36519f8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8112a5759c444c1f94be24ab61bf072f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:53:37.447753 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-6ce5a980-ec65-41f4-930c-9c78c6b6f963 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] 10.222.0.26 "GET /compute/v2.1/servers/c24fee69-5bf4-40f4-ba18-56aecd12dd96" status: 200 len: 1514 microversion: 2.1 time: 0.169116 Mar 05 02:53:37.448362 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 84/164] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:53:37 2022] GET /compute/v2.1/servers/c24fee69-5bf4-40f4-ba18-56aecd12dd96 => generated 1514 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 02:53:38.994822 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-9312ed23-7d96-4cca-b616-8f4d4fc3aeae tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 02:53:38.995919 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-9312ed23-7d96-4cca-b616-8f4d4fc3aeae tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] [instance: c24fee69-5bf4-40f4-ba18-56aecd12dd96] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:53:39.005536 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-9312ed23-7d96-4cca-b616-8f4d4fc3aeae tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:53:39.005994 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-9312ed23-7d96-4cca-b616-8f4d4fc3aeae tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:53:39.007038 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-9312ed23-7d96-4cca-b616-8f4d4fc3aeae tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:53:39.007458 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-9312ed23-7d96-4cca-b616-8f4d4fc3aeae tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:53:39.034062 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.objects.instance [None req-9312ed23-7d96-4cca-b616-8f4d4fc3aeae tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lazy-loading 'flavor' on Instance uuid c24fee69-5bf4-40f4-ba18-56aecd12dd96 {{(pid=123545) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 05 02:53:39.116154 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-9312ed23-7d96-4cca-b616-8f4d4fc3aeae tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] 10.222.0.26 "POST /compute/v2.1/servers/c24fee69-5bf4-40f4-ba18-56aecd12dd96/action" status: 200 len: 32 microversion: 2.1 time: 0.125801 Mar 05 02:53:39.117281 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 81/165] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Mar 5 02:53:38 2022] POST /compute/v2.1/servers/c24fee69-5bf4-40f4-ba18-56aecd12dd96/action => generated 32 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 05 02:53:39.127137 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-daaa99b2-7cf4-4f71-a73d-04e654422b59 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:53:39.133206 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-daaa99b2-7cf4-4f71-a73d-04e654422b59 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] [instance: c24fee69-5bf4-40f4-ba18-56aecd12dd96] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:53:39.143589 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-daaa99b2-7cf4-4f71-a73d-04e654422b59 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:53:39.144043 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-daaa99b2-7cf4-4f71-a73d-04e654422b59 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:53:39.144841 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-daaa99b2-7cf4-4f71-a73d-04e654422b59 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:53:39.145279 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-daaa99b2-7cf4-4f71-a73d-04e654422b59 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:53:39.331150 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-daaa99b2-7cf4-4f71-a73d-04e654422b59 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90033e5e8e634b699bf050e36519f8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8112a5759c444c1f94be24ab61bf072f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:53:39.341661 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-daaa99b2-7cf4-4f71-a73d-04e654422b59 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] 10.222.0.26 "GET /compute/v2.1/servers/c24fee69-5bf4-40f4-ba18-56aecd12dd96" status: 200 len: 1520 microversion: 2.1 time: 0.219465 Mar 05 02:53:39.345470 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 85/166] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:53:39 2022] GET /compute/v2.1/servers/c24fee69-5bf4-40f4-ba18-56aecd12dd96 => generated 1520 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 02:53:40.363565 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-b633ef1d-9d8a-4a8f-a28b-b7c513e153f0 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:53:40.364277 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-b633ef1d-9d8a-4a8f-a28b-b7c513e153f0 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] [instance: c24fee69-5bf4-40f4-ba18-56aecd12dd96] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:53:40.370637 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-b633ef1d-9d8a-4a8f-a28b-b7c513e153f0 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:53:40.371097 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-b633ef1d-9d8a-4a8f-a28b-b7c513e153f0 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:53:40.371872 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-b633ef1d-9d8a-4a8f-a28b-b7c513e153f0 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:53:40.372439 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-b633ef1d-9d8a-4a8f-a28b-b7c513e153f0 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:53:40.512794 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-b633ef1d-9d8a-4a8f-a28b-b7c513e153f0 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90033e5e8e634b699bf050e36519f8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8112a5759c444c1f94be24ab61bf072f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:53:40.522529 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-b633ef1d-9d8a-4a8f-a28b-b7c513e153f0 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] 10.222.0.26 "GET /compute/v2.1/servers/c24fee69-5bf4-40f4-ba18-56aecd12dd96" status: 200 len: 1520 microversion: 2.1 time: 0.163882 Mar 05 02:53:40.523237 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 82/167] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:53:40 2022] GET /compute/v2.1/servers/c24fee69-5bf4-40f4-ba18-56aecd12dd96 => generated 1520 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 02:53:41.038732 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-dd183d4d-002f-499c-9d05-6e2c2667d1c1 tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1408205648", "imageRef": "adbc7df1-116e-4f9f-a28d-a6a3c084cceb", "flavorRef": "452", "networks": [{"uuid": "bc3bb688-2082-4285-b145-f24c2a8d5bc2"}]}} {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 02:53:41.539750 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-8d1410df-656b-4ad3-a896-0b925480cb0f tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:53:41.540391 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-8d1410df-656b-4ad3-a896-0b925480cb0f tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] [instance: c24fee69-5bf4-40f4-ba18-56aecd12dd96] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:53:41.546760 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-8d1410df-656b-4ad3-a896-0b925480cb0f tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:53:41.547218 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-8d1410df-656b-4ad3-a896-0b925480cb0f tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:53:41.547996 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-8d1410df-656b-4ad3-a896-0b925480cb0f tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:53:41.548674 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-8d1410df-656b-4ad3-a896-0b925480cb0f tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:53:41.697329 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-8d1410df-656b-4ad3-a896-0b925480cb0f tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90033e5e8e634b699bf050e36519f8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8112a5759c444c1f94be24ab61bf072f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:53:41.706872 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-8d1410df-656b-4ad3-a896-0b925480cb0f tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] 10.222.0.26 "GET /compute/v2.1/servers/c24fee69-5bf4-40f4-ba18-56aecd12dd96" status: 200 len: 1520 microversion: 2.1 time: 0.170562 Mar 05 02:53:41.707652 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 83/168] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:53:41 2022] GET /compute/v2.1/servers/c24fee69-5bf4-40f4-ba18-56aecd12dd96 => generated 1520 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 02:53:42.724420 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-c7555ab2-eafb-4017-9808-ea1f58f5d464 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:53:42.725047 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-c7555ab2-eafb-4017-9808-ea1f58f5d464 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] [instance: c24fee69-5bf4-40f4-ba18-56aecd12dd96] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:53:42.731158 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-c7555ab2-eafb-4017-9808-ea1f58f5d464 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:53:42.731603 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-c7555ab2-eafb-4017-9808-ea1f58f5d464 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:53:42.732362 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-c7555ab2-eafb-4017-9808-ea1f58f5d464 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:53:42.732794 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-c7555ab2-eafb-4017-9808-ea1f58f5d464 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:53:42.868087 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-c7555ab2-eafb-4017-9808-ea1f58f5d464 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90033e5e8e634b699bf050e36519f8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8112a5759c444c1f94be24ab61bf072f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:53:42.875745 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-c7555ab2-eafb-4017-9808-ea1f58f5d464 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] 10.222.0.26 "GET /compute/v2.1/servers/c24fee69-5bf4-40f4-ba18-56aecd12dd96" status: 200 len: 1520 microversion: 2.1 time: 0.155056 Mar 05 02:53:42.876255 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 84/169] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:53:42 2022] GET /compute/v2.1/servers/c24fee69-5bf4-40f4-ba18-56aecd12dd96 => generated 1520 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 02:53:43.893267 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-6c96ad39-2532-464d-91ce-2519b7fa62d3 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:53:43.894006 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-6c96ad39-2532-464d-91ce-2519b7fa62d3 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] [instance: c24fee69-5bf4-40f4-ba18-56aecd12dd96] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:53:43.900336 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-6c96ad39-2532-464d-91ce-2519b7fa62d3 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:53:43.900805 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-6c96ad39-2532-464d-91ce-2519b7fa62d3 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:53:43.901569 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-6c96ad39-2532-464d-91ce-2519b7fa62d3 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:53:43.902024 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-6c96ad39-2532-464d-91ce-2519b7fa62d3 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:53:44.030822 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-6c96ad39-2532-464d-91ce-2519b7fa62d3 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90033e5e8e634b699bf050e36519f8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8112a5759c444c1f94be24ab61bf072f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:53:44.038033 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-6c96ad39-2532-464d-91ce-2519b7fa62d3 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] 10.222.0.26 "GET /compute/v2.1/servers/c24fee69-5bf4-40f4-ba18-56aecd12dd96" status: 200 len: 1520 microversion: 2.1 time: 0.149400 Mar 05 02:53:44.038604 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 85/170] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:53:43 2022] GET /compute/v2.1/servers/c24fee69-5bf4-40f4-ba18-56aecd12dd96 => generated 1520 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 02:53:45.055036 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-457d6ade-c081-437a-84da-43113d24bcc7 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:53:45.055827 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-457d6ade-c081-437a-84da-43113d24bcc7 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] [instance: c24fee69-5bf4-40f4-ba18-56aecd12dd96] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:53:45.062209 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-457d6ade-c081-437a-84da-43113d24bcc7 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:53:45.062669 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-457d6ade-c081-437a-84da-43113d24bcc7 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:53:45.063448 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-457d6ade-c081-437a-84da-43113d24bcc7 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:53:45.063883 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-457d6ade-c081-437a-84da-43113d24bcc7 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:53:45.205658 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-457d6ade-c081-437a-84da-43113d24bcc7 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90033e5e8e634b699bf050e36519f8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8112a5759c444c1f94be24ab61bf072f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:53:45.213361 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-457d6ade-c081-437a-84da-43113d24bcc7 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] 10.222.0.26 "GET /compute/v2.1/servers/c24fee69-5bf4-40f4-ba18-56aecd12dd96" status: 200 len: 1520 microversion: 2.1 time: 0.162191 Mar 05 02:53:45.213936 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 86/171] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:53:45 2022] GET /compute/v2.1/servers/c24fee69-5bf4-40f4-ba18-56aecd12dd96 => generated 1520 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 02:53:46.230039 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-1f59d356-569f-42f4-af3c-18f64f995962 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:53:46.230649 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-1f59d356-569f-42f4-af3c-18f64f995962 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] [instance: c24fee69-5bf4-40f4-ba18-56aecd12dd96] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:53:46.237654 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-1f59d356-569f-42f4-af3c-18f64f995962 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:53:46.238203 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-1f59d356-569f-42f4-af3c-18f64f995962 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:53:46.238980 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-1f59d356-569f-42f4-af3c-18f64f995962 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:53:46.239422 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-1f59d356-569f-42f4-af3c-18f64f995962 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:53:46.386314 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-1f59d356-569f-42f4-af3c-18f64f995962 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90033e5e8e634b699bf050e36519f8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8112a5759c444c1f94be24ab61bf072f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:53:46.393611 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-1f59d356-569f-42f4-af3c-18f64f995962 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] 10.222.0.26 "GET /compute/v2.1/servers/c24fee69-5bf4-40f4-ba18-56aecd12dd96" status: 200 len: 1520 microversion: 2.1 time: 0.167671 Mar 05 02:53:46.394214 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 87/172] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:53:46 2022] GET /compute/v2.1/servers/c24fee69-5bf4-40f4-ba18-56aecd12dd96 => generated 1520 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 02:53:47.410530 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-d5b442cc-d786-4dfd-9313-20ae6ebe23a6 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:53:47.411185 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-d5b442cc-d786-4dfd-9313-20ae6ebe23a6 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] [instance: c24fee69-5bf4-40f4-ba18-56aecd12dd96] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:53:47.416857 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-d5b442cc-d786-4dfd-9313-20ae6ebe23a6 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:53:47.417309 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-d5b442cc-d786-4dfd-9313-20ae6ebe23a6 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:53:47.418092 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-d5b442cc-d786-4dfd-9313-20ae6ebe23a6 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:53:47.418529 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-d5b442cc-d786-4dfd-9313-20ae6ebe23a6 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:53:47.552517 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-d5b442cc-d786-4dfd-9313-20ae6ebe23a6 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90033e5e8e634b699bf050e36519f8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8112a5759c444c1f94be24ab61bf072f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:53:47.562220 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-d5b442cc-d786-4dfd-9313-20ae6ebe23a6 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] 10.222.0.26 "GET /compute/v2.1/servers/c24fee69-5bf4-40f4-ba18-56aecd12dd96" status: 200 len: 1520 microversion: 2.1 time: 0.154618 Mar 05 02:53:47.563274 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 88/173] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:53:47 2022] GET /compute/v2.1/servers/c24fee69-5bf4-40f4-ba18-56aecd12dd96 => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 02:53:48.578996 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-bd8a52ab-f1d4-4b49-93c7-d5faa35ac774 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:53:48.579651 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-bd8a52ab-f1d4-4b49-93c7-d5faa35ac774 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] [instance: c24fee69-5bf4-40f4-ba18-56aecd12dd96] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:53:48.585410 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-bd8a52ab-f1d4-4b49-93c7-d5faa35ac774 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:53:48.585854 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-bd8a52ab-f1d4-4b49-93c7-d5faa35ac774 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:53:48.586646 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-bd8a52ab-f1d4-4b49-93c7-d5faa35ac774 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:53:48.587076 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-bd8a52ab-f1d4-4b49-93c7-d5faa35ac774 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:53:48.725642 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-bd8a52ab-f1d4-4b49-93c7-d5faa35ac774 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90033e5e8e634b699bf050e36519f8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8112a5759c444c1f94be24ab61bf072f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:53:48.733975 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-bd8a52ab-f1d4-4b49-93c7-d5faa35ac774 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] 10.222.0.26 "GET /compute/v2.1/servers/c24fee69-5bf4-40f4-ba18-56aecd12dd96" status: 200 len: 1520 microversion: 2.1 time: 0.158438 Mar 05 02:53:48.734550 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 89/174] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:53:48 2022] GET /compute/v2.1/servers/c24fee69-5bf4-40f4-ba18-56aecd12dd96 => generated 1520 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 02:53:49.469543 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.network.neutron [None req-dd183d4d-002f-499c-9d05-6e2c2667d1c1 tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] validate_networks() for [('bc3bb688-2082-4285-b145-f24c2a8d5bc2', None, None, None, None, None)] {{(pid=123546) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 05 02:53:49.751927 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-c180e867-342d-4a62-88d2-0b10109d9d1c tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:53:49.752539 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-c180e867-342d-4a62-88d2-0b10109d9d1c tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] [instance: c24fee69-5bf4-40f4-ba18-56aecd12dd96] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:53:49.758255 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-c180e867-342d-4a62-88d2-0b10109d9d1c tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:53:49.758800 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-c180e867-342d-4a62-88d2-0b10109d9d1c tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:53:49.759488 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-c180e867-342d-4a62-88d2-0b10109d9d1c tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:53:49.759930 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-c180e867-342d-4a62-88d2-0b10109d9d1c tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:53:50.042317 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.virt.hardware [None req-dd183d4d-002f-499c-9d05-6e2c2667d1c1 tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] Flavor limits 0:0:0 {{(pid=123546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 05 02:53:50.042744 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.virt.hardware [None req-dd183d4d-002f-499c-9d05-6e2c2667d1c1 tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] Image limits 0:0:0 {{(pid=123546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 05 02:53:50.043245 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.virt.hardware [None req-dd183d4d-002f-499c-9d05-6e2c2667d1c1 tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] Flavor pref 0:0:0 {{(pid=123546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 05 02:53:50.043654 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.virt.hardware [None req-dd183d4d-002f-499c-9d05-6e2c2667d1c1 tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] Image pref 0:0:0 {{(pid=123546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 05 02:53:50.044066 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.virt.hardware [None req-dd183d4d-002f-499c-9d05-6e2c2667d1c1 tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 05 02:53:50.053589 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-dd183d4d-002f-499c-9d05-6e2c2667d1c1 tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:53:50.054068 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-dd183d4d-002f-499c-9d05-6e2c2667d1c1 tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:53:50.054868 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-dd183d4d-002f-499c-9d05-6e2c2667d1c1 tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:53:50.055306 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-dd183d4d-002f-499c-9d05-6e2c2667d1c1 tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:53:50.073854 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.quota [None req-dd183d4d-002f-499c-9d05-6e2c2667d1c1 tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] Getting quotas for project 3afb5b14217e4a54ab03e6233f8aaa07. Resources: {'ram', 'cores', 'instances'} {{(pid=123546) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 02:53:50.078236 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.quota [None req-dd183d4d-002f-499c-9d05-6e2c2667d1c1 tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] Getting quotas for user 1700aa8052b94f878886b08f94f05831 and project 3afb5b14217e4a54ab03e6233f8aaa07. Resources: {'ram', 'cores', 'instances'} {{(pid=123546) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 02:53:50.089314 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-dd183d4d-002f-499c-9d05-6e2c2667d1c1 tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] Going to run 1 instances... {{(pid=123546) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 05 02:53:50.091629 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-dd183d4d-002f-499c-9d05-6e2c2667d1c1 tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] [instance: 1330ae1f-2dd0-436c-bbaa-c3c2d711fb83] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='adbc7df1-116e-4f9f-a28d-a6a3c084cceb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123546) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 05 02:53:50.107425 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-c180e867-342d-4a62-88d2-0b10109d9d1c tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90033e5e8e634b699bf050e36519f8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8112a5759c444c1f94be24ab61bf072f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:53:50.115581 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-c180e867-342d-4a62-88d2-0b10109d9d1c tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] 10.222.0.26 "GET /compute/v2.1/servers/c24fee69-5bf4-40f4-ba18-56aecd12dd96" status: 200 len: 1520 microversion: 2.1 time: 0.368744 Mar 05 02:53:50.116147 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 90/175] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:53:49 2022] GET /compute/v2.1/servers/c24fee69-5bf4-40f4-ba18-56aecd12dd96 => generated 1520 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 02:53:50.141304 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-dd183d4d-002f-499c-9d05-6e2c2667d1c1 tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 9.106382 Mar 05 02:53:50.142128 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 86/176] 10.222.0.26 () {60 vars in 1146 bytes} [Sat Mar 5 02:53:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 9108 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 05 02:53:50.151896 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-51fe1077-09f7-48e9-b3e1-dfc2461a731e tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:53:50.152501 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-51fe1077-09f7-48e9-b3e1-dfc2461a731e tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] [instance: 1330ae1f-2dd0-436c-bbaa-c3c2d711fb83] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:53:50.208175 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-51fe1077-09f7-48e9-b3e1-dfc2461a731e tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1700aa8052b94f878886b08f94f05831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3afb5b14217e4a54ab03e6233f8aaa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:53:50.214661 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-51fe1077-09f7-48e9-b3e1-dfc2461a731e tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] 10.222.0.26 "GET /compute/v2.1/servers/1330ae1f-2dd0-436c-bbaa-c3c2d711fb83" status: 200 len: 1214 microversion: 2.1 time: 0.066634 Mar 05 02:53:50.215234 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 91/177] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:53:50 2022] GET /compute/v2.1/servers/1330ae1f-2dd0-436c-bbaa-c3c2d711fb83 => generated 1214 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 02:53:51.133129 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-64cc9c14-e05a-44d8-87ab-875dc8a9e73b tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:53:51.133923 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-64cc9c14-e05a-44d8-87ab-875dc8a9e73b tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] [instance: c24fee69-5bf4-40f4-ba18-56aecd12dd96] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:53:51.140729 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-64cc9c14-e05a-44d8-87ab-875dc8a9e73b tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:53:51.141180 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-64cc9c14-e05a-44d8-87ab-875dc8a9e73b tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:53:51.142534 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-64cc9c14-e05a-44d8-87ab-875dc8a9e73b tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:53:51.142969 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-64cc9c14-e05a-44d8-87ab-875dc8a9e73b tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:53:51.236020 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-dab728b7-ad01-4af1-95b9-990145b8557c tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:53:51.237145 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-dab728b7-ad01-4af1-95b9-990145b8557c tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] [instance: 1330ae1f-2dd0-436c-bbaa-c3c2d711fb83] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:53:51.246210 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-dab728b7-ad01-4af1-95b9-990145b8557c tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:53:51.247095 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-dab728b7-ad01-4af1-95b9-990145b8557c tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:53:51.248166 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-dab728b7-ad01-4af1-95b9-990145b8557c tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:53:51.248925 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-dab728b7-ad01-4af1-95b9-990145b8557c tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:53:51.286664 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-64cc9c14-e05a-44d8-87ab-875dc8a9e73b tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90033e5e8e634b699bf050e36519f8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8112a5759c444c1f94be24ab61bf072f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:53:51.295070 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-64cc9c14-e05a-44d8-87ab-875dc8a9e73b tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] 10.222.0.26 "GET /compute/v2.1/servers/c24fee69-5bf4-40f4-ba18-56aecd12dd96" status: 200 len: 1520 microversion: 2.1 time: 0.166364 Mar 05 02:53:51.295774 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 87/178] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:53:51 2022] GET /compute/v2.1/servers/c24fee69-5bf4-40f4-ba18-56aecd12dd96 => generated 1520 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 02:53:51.316319 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-dab728b7-ad01-4af1-95b9-990145b8557c tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1700aa8052b94f878886b08f94f05831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3afb5b14217e4a54ab03e6233f8aaa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:53:51.324679 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-dab728b7-ad01-4af1-95b9-990145b8557c tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] 10.222.0.26 "GET /compute/v2.1/servers/1330ae1f-2dd0-436c-bbaa-c3c2d711fb83" status: 200 len: 1284 microversion: 2.1 time: 0.096090 Mar 05 02:53:51.325260 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 92/179] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:53:51 2022] GET /compute/v2.1/servers/1330ae1f-2dd0-436c-bbaa-c3c2d711fb83 => generated 1284 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 02:53:51.699023 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-b8ecc526-9824-4073-833d-14f90903e779 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:53:51.699653 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-b8ecc526-9824-4073-833d-14f90903e779 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] [instance: e28e570d-3d50-4fe8-bb4a-fe0e95c20fb7] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:53:51.706534 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-b8ecc526-9824-4073-833d-14f90903e779 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:53:51.707373 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-b8ecc526-9824-4073-833d-14f90903e779 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:53:51.708392 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-b8ecc526-9824-4073-833d-14f90903e779 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:53:51.709058 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-b8ecc526-9824-4073-833d-14f90903e779 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:53:51.740748 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-b8ecc526-9824-4073-833d-14f90903e779 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] 10.222.0.26 "GET /compute/v2.1/servers/e28e570d-3d50-4fe8-bb4a-fe0e95c20fb7/ips" status: 200 len: 151 microversion: 2.20 time: 0.045785 Mar 05 02:53:51.741348 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 88/180] 10.222.0.26 () {60 vars in 1288 bytes} [Sat Mar 5 02:53:51 2022] GET /compute/v2.1/servers/e28e570d-3d50-4fe8-bb4a-fe0e95c20fb7/ips => generated 151 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 05 02:53:52.313502 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-a36daf06-a8c8-4f4b-9a00-d8f41eba6195 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:53:52.314558 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-a36daf06-a8c8-4f4b-9a00-d8f41eba6195 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] [instance: c24fee69-5bf4-40f4-ba18-56aecd12dd96] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:53:52.320917 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-a36daf06-a8c8-4f4b-9a00-d8f41eba6195 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:53:52.321375 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-a36daf06-a8c8-4f4b-9a00-d8f41eba6195 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:53:52.322178 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-a36daf06-a8c8-4f4b-9a00-d8f41eba6195 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:53:52.322608 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-a36daf06-a8c8-4f4b-9a00-d8f41eba6195 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:53:52.343487 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-7a07c887-85be-4043-a55f-159c447fc1df tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:53:52.344789 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-7a07c887-85be-4043-a55f-159c447fc1df tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] [instance: 1330ae1f-2dd0-436c-bbaa-c3c2d711fb83] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:53:52.352116 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-7a07c887-85be-4043-a55f-159c447fc1df tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:53:52.352791 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-7a07c887-85be-4043-a55f-159c447fc1df tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:53:52.353722 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-7a07c887-85be-4043-a55f-159c447fc1df tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:53:52.356450 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-7a07c887-85be-4043-a55f-159c447fc1df tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:53:52.541971 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-a36daf06-a8c8-4f4b-9a00-d8f41eba6195 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90033e5e8e634b699bf050e36519f8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8112a5759c444c1f94be24ab61bf072f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:53:52.549816 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-a36daf06-a8c8-4f4b-9a00-d8f41eba6195 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] 10.222.0.26 "GET /compute/v2.1/servers/c24fee69-5bf4-40f4-ba18-56aecd12dd96" status: 200 len: 1520 microversion: 2.1 time: 0.240610 Mar 05 02:53:52.550023 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 93/181] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:53:52 2022] GET /compute/v2.1/servers/c24fee69-5bf4-40f4-ba18-56aecd12dd96 => generated 1520 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 02:53:52.585605 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-7a07c887-85be-4043-a55f-159c447fc1df tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1700aa8052b94f878886b08f94f05831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3afb5b14217e4a54ab03e6233f8aaa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:53:52.594819 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-7a07c887-85be-4043-a55f-159c447fc1df tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] 10.222.0.26 "GET /compute/v2.1/servers/1330ae1f-2dd0-436c-bbaa-c3c2d711fb83" status: 200 len: 1314 microversion: 2.1 time: 0.254646 Mar 05 02:53:52.597064 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 89/182] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:53:52 2022] GET /compute/v2.1/servers/1330ae1f-2dd0-436c-bbaa-c3c2d711fb83 => generated 1314 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 02:53:52.691322 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [req-5c7a5fd9-7bb0-49d9-9461-15bde599540b req-2394a6b1-0718-4cb6-a09e-a45488127a20 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1330ae1f-2dd0-436c-bbaa-c3c2d711fb83", "tag": "9fad6e24-25a4-407a-bdaf-607bca1d98a2"}]} {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 02:53:52.700579 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [req-5c7a5fd9-7bb0-49d9-9461-15bde599540b req-2394a6b1-0718-4cb6-a09e-a45488127a20 service nova] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:53:52.701451 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [req-5c7a5fd9-7bb0-49d9-9461-15bde599540b req-2394a6b1-0718-4cb6-a09e-a45488127a20 service nova] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:53:52.714791 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.compute.server_external_events [req-5c7a5fd9-7bb0-49d9-9461-15bde599540b req-2394a6b1-0718-4cb6-a09e-a45488127a20 service nova] Creating event network-changed:9fad6e24-25a4-407a-bdaf-607bca1d98a2 for instance 1330ae1f-2dd0-436c-bbaa-c3c2d711fb83 on hv-cinder-82725 Mar 05 02:53:52.720839 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [req-5c7a5fd9-7bb0-49d9-9461-15bde599540b req-2394a6b1-0718-4cb6-a09e-a45488127a20 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039702 Mar 05 02:53:52.722144 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 94/183] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Mar 5 02:53:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 02:53:53.566930 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-177041f0-303c-4238-af12-60d6f5fd9a40 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:53:53.567491 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-177041f0-303c-4238-af12-60d6f5fd9a40 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] [instance: c24fee69-5bf4-40f4-ba18-56aecd12dd96] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:53:53.574614 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-177041f0-303c-4238-af12-60d6f5fd9a40 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:53:53.575075 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-177041f0-303c-4238-af12-60d6f5fd9a40 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:53:53.575867 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-177041f0-303c-4238-af12-60d6f5fd9a40 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:53:53.576513 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-177041f0-303c-4238-af12-60d6f5fd9a40 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:53:53.613538 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-9633d47c-47dd-4112-af46-dc810db883ab tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:53:53.614268 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-9633d47c-47dd-4112-af46-dc810db883ab tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] [instance: 1330ae1f-2dd0-436c-bbaa-c3c2d711fb83] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:53:53.626423 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-9633d47c-47dd-4112-af46-dc810db883ab tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:53:53.626878 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-9633d47c-47dd-4112-af46-dc810db883ab tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:53:53.627753 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-9633d47c-47dd-4112-af46-dc810db883ab tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:53:53.628193 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-9633d47c-47dd-4112-af46-dc810db883ab tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:53:53.769561 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-177041f0-303c-4238-af12-60d6f5fd9a40 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90033e5e8e634b699bf050e36519f8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8112a5759c444c1f94be24ab61bf072f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:53:53.777209 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-177041f0-303c-4238-af12-60d6f5fd9a40 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] 10.222.0.26 "GET /compute/v2.1/servers/c24fee69-5bf4-40f4-ba18-56aecd12dd96" status: 200 len: 1520 microversion: 2.1 time: 0.214596 Mar 05 02:53:53.777818 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 90/184] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:53:53 2022] GET /compute/v2.1/servers/c24fee69-5bf4-40f4-ba18-56aecd12dd96 => generated 1520 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 02:53:53.831147 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-9633d47c-47dd-4112-af46-dc810db883ab tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1700aa8052b94f878886b08f94f05831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3afb5b14217e4a54ab03e6233f8aaa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:53:53.839010 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-9633d47c-47dd-4112-af46-dc810db883ab tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] 10.222.0.26 "GET /compute/v2.1/servers/1330ae1f-2dd0-436c-bbaa-c3c2d711fb83" status: 200 len: 1314 microversion: 2.1 time: 0.229701 Mar 05 02:53:53.839578 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 95/185] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:53:53 2022] GET /compute/v2.1/servers/1330ae1f-2dd0-436c-bbaa-c3c2d711fb83 => generated 1314 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 02:53:54.365523 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-3a54c67b-4a88-4f0c-a643-03abdecfc047 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:53:54.366045 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-3a54c67b-4a88-4f0c-a643-03abdecfc047 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] [instance: d0080e4b-6532-4e0c-8d19-cfbdf32e401b] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:53:54.371883 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-3a54c67b-4a88-4f0c-a643-03abdecfc047 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:53:54.372327 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-3a54c67b-4a88-4f0c-a643-03abdecfc047 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:53:54.373083 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-3a54c67b-4a88-4f0c-a643-03abdecfc047 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:53:54.373585 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-3a54c67b-4a88-4f0c-a643-03abdecfc047 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:53:54.395577 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-3a54c67b-4a88-4f0c-a643-03abdecfc047 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] 10.222.0.26 "GET /compute/v2.1/servers/d0080e4b-6532-4e0c-8d19-cfbdf32e401b/ips" status: 200 len: 146 microversion: 2.1 time: 0.034082 Mar 05 02:53:54.396134 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 91/186] 10.222.0.26 () {58 vars in 1247 bytes} [Sat Mar 5 02:53:54 2022] GET /compute/v2.1/servers/d0080e4b-6532-4e0c-8d19-cfbdf32e401b/ips => generated 146 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 02:53:54.433669 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-395e9ffc-ab95-4039-ae32-3fdc5a618862 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 02:53:54.434224 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-395e9ffc-ab95-4039-ae32-3fdc5a618862 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] [instance: e28e570d-3d50-4fe8-bb4a-fe0e95c20fb7] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:53:54.441081 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-395e9ffc-ab95-4039-ae32-3fdc5a618862 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:53:54.441523 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-395e9ffc-ab95-4039-ae32-3fdc5a618862 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:53:54.442318 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-395e9ffc-ab95-4039-ae32-3fdc5a618862 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:53:54.442749 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-395e9ffc-ab95-4039-ae32-3fdc5a618862 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:53:54.465405 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.objects.instance [None req-395e9ffc-ab95-4039-ae32-3fdc5a618862 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lazy-loading 'flavor' on Instance uuid e28e570d-3d50-4fe8-bb4a-fe0e95c20fb7 {{(pid=123545) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 05 02:53:54.761026 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-395e9ffc-ab95-4039-ae32-3fdc5a618862 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] 10.222.0.26 "POST /compute/v2.1/servers/e28e570d-3d50-4fe8-bb4a-fe0e95c20fb7/action" status: 202 len: 0 microversion: 2.20 time: 0.331085 Mar 05 02:53:54.761717 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 96/187] 10.222.0.26 () {62 vars in 1318 bytes} [Sat Mar 5 02:53:54 2022] POST /compute/v2.1/servers/e28e570d-3d50-4fe8-bb4a-fe0e95c20fb7/action => generated 0 bytes in 333 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Mar 05 02:53:54.778864 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-c741cb8e-3608-44d4-95cc-73f934946fc4 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:53:54.778864 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-c741cb8e-3608-44d4-95cc-73f934946fc4 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] [instance: e28e570d-3d50-4fe8-bb4a-fe0e95c20fb7] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:53:54.789236 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-c741cb8e-3608-44d4-95cc-73f934946fc4 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:53:54.789661 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-c741cb8e-3608-44d4-95cc-73f934946fc4 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:53:54.790776 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-c741cb8e-3608-44d4-95cc-73f934946fc4 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:53:54.791334 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-c741cb8e-3608-44d4-95cc-73f934946fc4 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:53:54.797870 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-734a2d6b-f3ec-4288-81a7-baf84348fea9 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:53:54.798751 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-734a2d6b-f3ec-4288-81a7-baf84348fea9 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] [instance: c24fee69-5bf4-40f4-ba18-56aecd12dd96] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:53:54.808248 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-734a2d6b-f3ec-4288-81a7-baf84348fea9 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:53:54.808697 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-734a2d6b-f3ec-4288-81a7-baf84348fea9 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:53:54.809480 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-734a2d6b-f3ec-4288-81a7-baf84348fea9 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:53:54.809917 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-734a2d6b-f3ec-4288-81a7-baf84348fea9 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:53:55.006227 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-734a2d6b-f3ec-4288-81a7-baf84348fea9 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90033e5e8e634b699bf050e36519f8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8112a5759c444c1f94be24ab61bf072f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:53:55.009443 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-c741cb8e-3608-44d4-95cc-73f934946fc4 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:53:55.013647 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-734a2d6b-f3ec-4288-81a7-baf84348fea9 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] 10.222.0.26 "GET /compute/v2.1/servers/c24fee69-5bf4-40f4-ba18-56aecd12dd96" status: 200 len: 1520 microversion: 2.1 time: 0.221838 Mar 05 02:53:55.015072 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 97/188] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:53:54 2022] GET /compute/v2.1/servers/c24fee69-5bf4-40f4-ba18-56aecd12dd96 => generated 1520 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 02:53:55.018689 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-c741cb8e-3608-44d4-95cc-73f934946fc4 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:53:55.019754 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-1eb1728e-52d2-4d66-bc77-2a21c191e2b1 tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:53:55.020350 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-1eb1728e-52d2-4d66-bc77-2a21c191e2b1 tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] [instance: 1330ae1f-2dd0-436c-bbaa-c3c2d711fb83] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:53:55.020467 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-c741cb8e-3608-44d4-95cc-73f934946fc4 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:53:55.021556 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-c741cb8e-3608-44d4-95cc-73f934946fc4 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] 10.222.0.26 "GET /compute/v2.1/servers/e28e570d-3d50-4fe8-bb4a-fe0e95c20fb7" status: 200 len: 1723 microversion: 2.20 time: 0.250243 Mar 05 02:53:55.022128 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 92/189] 10.222.0.26 () {60 vars in 1276 bytes} [Sat Mar 5 02:53:54 2022] GET /compute/v2.1/servers/e28e570d-3d50-4fe8-bb4a-fe0e95c20fb7 => generated 1723 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 02:53:55.026772 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-1eb1728e-52d2-4d66-bc77-2a21c191e2b1 tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:53:55.027226 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-1eb1728e-52d2-4d66-bc77-2a21c191e2b1 tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:53:55.027990 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-1eb1728e-52d2-4d66-bc77-2a21c191e2b1 tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:53:55.028422 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-1eb1728e-52d2-4d66-bc77-2a21c191e2b1 tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:53:55.160198 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-1eb1728e-52d2-4d66-bc77-2a21c191e2b1 tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1700aa8052b94f878886b08f94f05831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3afb5b14217e4a54ab03e6233f8aaa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:53:55.167348 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-1eb1728e-52d2-4d66-bc77-2a21c191e2b1 tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] 10.222.0.26 "GET /compute/v2.1/servers/1330ae1f-2dd0-436c-bbaa-c3c2d711fb83" status: 200 len: 1314 microversion: 2.1 time: 0.151100 Mar 05 02:53:55.167909 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 98/190] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:53:55 2022] GET /compute/v2.1/servers/1330ae1f-2dd0-436c-bbaa-c3c2d711fb83 => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 02:53:56.031150 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-6f6524a3-8ca7-4fc8-ab20-a549bfb4fba2 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:53:56.031687 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-6f6524a3-8ca7-4fc8-ab20-a549bfb4fba2 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] [instance: c24fee69-5bf4-40f4-ba18-56aecd12dd96] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:53:56.038040 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-6f6524a3-8ca7-4fc8-ab20-a549bfb4fba2 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:53:56.038489 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-6f6524a3-8ca7-4fc8-ab20-a549bfb4fba2 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:53:56.039253 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-6f6524a3-8ca7-4fc8-ab20-a549bfb4fba2 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:53:56.039686 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-6f6524a3-8ca7-4fc8-ab20-a549bfb4fba2 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:53:56.040993 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-6a7e70c6-7d3a-4c77-9c62-02f609a2c5c8 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:53:56.041603 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-6a7e70c6-7d3a-4c77-9c62-02f609a2c5c8 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] [instance: e28e570d-3d50-4fe8-bb4a-fe0e95c20fb7] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:53:56.048652 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-6a7e70c6-7d3a-4c77-9c62-02f609a2c5c8 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:53:56.049092 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-6a7e70c6-7d3a-4c77-9c62-02f609a2c5c8 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:53:56.049870 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-6a7e70c6-7d3a-4c77-9c62-02f609a2c5c8 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:53:56.050329 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-6a7e70c6-7d3a-4c77-9c62-02f609a2c5c8 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:53:56.238489 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-6f6524a3-8ca7-4fc8-ab20-a549bfb4fba2 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90033e5e8e634b699bf050e36519f8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8112a5759c444c1f94be24ab61bf072f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:53:56.245528 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-6a7e70c6-7d3a-4c77-9c62-02f609a2c5c8 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:53:56.246879 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-6f6524a3-8ca7-4fc8-ab20-a549bfb4fba2 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] 10.222.0.26 "GET /compute/v2.1/servers/c24fee69-5bf4-40f4-ba18-56aecd12dd96" status: 200 len: 1520 microversion: 2.1 time: 0.220081 Mar 05 02:53:56.249087 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 93/191] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:53:56 2022] GET /compute/v2.1/servers/c24fee69-5bf4-40f4-ba18-56aecd12dd96 => generated 1520 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 02:53:56.253984 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-eaca4359-16b1-4650-921f-da31c2b75675 tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:53:56.254407 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-6a7e70c6-7d3a-4c77-9c62-02f609a2c5c8 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:53:56.254811 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-eaca4359-16b1-4650-921f-da31c2b75675 tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] [instance: 1330ae1f-2dd0-436c-bbaa-c3c2d711fb83] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:53:56.256281 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-6a7e70c6-7d3a-4c77-9c62-02f609a2c5c8 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:53:56.257595 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-6a7e70c6-7d3a-4c77-9c62-02f609a2c5c8 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] 10.222.0.26 "GET /compute/v2.1/servers/e28e570d-3d50-4fe8-bb4a-fe0e95c20fb7" status: 200 len: 1723 microversion: 2.20 time: 0.220815 Mar 05 02:53:56.258328 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 99/192] 10.222.0.26 () {60 vars in 1276 bytes} [Sat Mar 5 02:53:56 2022] GET /compute/v2.1/servers/e28e570d-3d50-4fe8-bb4a-fe0e95c20fb7 => generated 1723 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 05 02:53:56.260888 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-eaca4359-16b1-4650-921f-da31c2b75675 tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:53:56.261339 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-eaca4359-16b1-4650-921f-da31c2b75675 tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:53:56.262149 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-eaca4359-16b1-4650-921f-da31c2b75675 tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:53:56.262617 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-eaca4359-16b1-4650-921f-da31c2b75675 tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:53:56.408070 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-eaca4359-16b1-4650-921f-da31c2b75675 tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1700aa8052b94f878886b08f94f05831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3afb5b14217e4a54ab03e6233f8aaa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:53:56.415231 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-eaca4359-16b1-4650-921f-da31c2b75675 tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] 10.222.0.26 "GET /compute/v2.1/servers/1330ae1f-2dd0-436c-bbaa-c3c2d711fb83" status: 200 len: 1314 microversion: 2.1 time: 0.164886 Mar 05 02:53:56.415797 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 94/193] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:53:56 2022] GET /compute/v2.1/servers/1330ae1f-2dd0-436c-bbaa-c3c2d711fb83 => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 02:53:57.263633 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-4208dbcc-7dd5-4eb2-8188-4f99f61ab629 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:53:57.264356 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-4208dbcc-7dd5-4eb2-8188-4f99f61ab629 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] [instance: c24fee69-5bf4-40f4-ba18-56aecd12dd96] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:53:57.270304 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-4208dbcc-7dd5-4eb2-8188-4f99f61ab629 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:53:57.270748 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-4208dbcc-7dd5-4eb2-8188-4f99f61ab629 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:53:57.271503 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-4208dbcc-7dd5-4eb2-8188-4f99f61ab629 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:53:57.272036 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-4208dbcc-7dd5-4eb2-8188-4f99f61ab629 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:53:57.277867 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-274bd5b6-396d-4c3e-b03f-0519cd9f18e6 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:53:57.278794 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-274bd5b6-396d-4c3e-b03f-0519cd9f18e6 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] [instance: e28e570d-3d50-4fe8-bb4a-fe0e95c20fb7] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:53:57.287882 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-274bd5b6-396d-4c3e-b03f-0519cd9f18e6 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:53:57.288335 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-274bd5b6-396d-4c3e-b03f-0519cd9f18e6 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:53:57.289112 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-274bd5b6-396d-4c3e-b03f-0519cd9f18e6 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:53:57.289552 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-274bd5b6-396d-4c3e-b03f-0519cd9f18e6 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:53:57.470750 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-4208dbcc-7dd5-4eb2-8188-4f99f61ab629 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90033e5e8e634b699bf050e36519f8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8112a5759c444c1f94be24ab61bf072f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:53:57.477241 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-274bd5b6-396d-4c3e-b03f-0519cd9f18e6 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:53:57.478230 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-4208dbcc-7dd5-4eb2-8188-4f99f61ab629 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] 10.222.0.26 "GET /compute/v2.1/servers/c24fee69-5bf4-40f4-ba18-56aecd12dd96" status: 200 len: 1520 microversion: 2.1 time: 0.218440 Mar 05 02:53:57.478887 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 100/194] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:53:57 2022] GET /compute/v2.1/servers/c24fee69-5bf4-40f4-ba18-56aecd12dd96 => generated 1520 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 02:53:57.484115 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-a0d1ad69-964f-4e13-9b55-5631819d415f tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:53:57.484785 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-a0d1ad69-964f-4e13-9b55-5631819d415f tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] [instance: 1330ae1f-2dd0-436c-bbaa-c3c2d711fb83] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:53:57.487032 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-274bd5b6-396d-4c3e-b03f-0519cd9f18e6 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:53:57.489725 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-274bd5b6-396d-4c3e-b03f-0519cd9f18e6 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:53:57.491099 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-274bd5b6-396d-4c3e-b03f-0519cd9f18e6 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] 10.222.0.26 "GET /compute/v2.1/servers/e28e570d-3d50-4fe8-bb4a-fe0e95c20fb7" status: 200 len: 1723 microversion: 2.20 time: 0.218462 Mar 05 02:53:57.491398 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-a0d1ad69-964f-4e13-9b55-5631819d415f tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:53:57.491656 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 95/195] 10.222.0.26 () {60 vars in 1276 bytes} [Sat Mar 5 02:53:57 2022] GET /compute/v2.1/servers/e28e570d-3d50-4fe8-bb4a-fe0e95c20fb7 => generated 1723 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 05 02:53:57.491844 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-a0d1ad69-964f-4e13-9b55-5631819d415f tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:53:57.492605 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-a0d1ad69-964f-4e13-9b55-5631819d415f tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:53:57.493035 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-a0d1ad69-964f-4e13-9b55-5631819d415f tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:53:57.626294 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-a0d1ad69-964f-4e13-9b55-5631819d415f tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1700aa8052b94f878886b08f94f05831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3afb5b14217e4a54ab03e6233f8aaa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:53:57.633340 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-a0d1ad69-964f-4e13-9b55-5631819d415f tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] 10.222.0.26 "GET /compute/v2.1/servers/1330ae1f-2dd0-436c-bbaa-c3c2d711fb83" status: 200 len: 1314 microversion: 2.1 time: 0.153219 Mar 05 02:53:57.633902 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 101/196] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:53:57 2022] GET /compute/v2.1/servers/1330ae1f-2dd0-436c-bbaa-c3c2d711fb83 => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 02:53:58.497165 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-c4b508d2-ebc0-4371-bb5c-d3b768cf342e tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:53:58.497928 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-c4b508d2-ebc0-4371-bb5c-d3b768cf342e tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] [instance: c24fee69-5bf4-40f4-ba18-56aecd12dd96] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:53:58.505004 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-c4b508d2-ebc0-4371-bb5c-d3b768cf342e tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:53:58.505535 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-c4b508d2-ebc0-4371-bb5c-d3b768cf342e tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:53:58.506395 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-c4b508d2-ebc0-4371-bb5c-d3b768cf342e tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:53:58.506895 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-c4b508d2-ebc0-4371-bb5c-d3b768cf342e tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:53:58.509335 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-0aa2cb8f-a525-49c3-a847-fad36d10ccf4 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:53:58.510159 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-0aa2cb8f-a525-49c3-a847-fad36d10ccf4 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] [instance: e28e570d-3d50-4fe8-bb4a-fe0e95c20fb7] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:53:58.516759 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-0aa2cb8f-a525-49c3-a847-fad36d10ccf4 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:53:58.517360 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-0aa2cb8f-a525-49c3-a847-fad36d10ccf4 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:53:58.518213 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-0aa2cb8f-a525-49c3-a847-fad36d10ccf4 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:53:58.518717 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-0aa2cb8f-a525-49c3-a847-fad36d10ccf4 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:53:58.709907 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-c4b508d2-ebc0-4371-bb5c-d3b768cf342e tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90033e5e8e634b699bf050e36519f8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8112a5759c444c1f94be24ab61bf072f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:53:58.728720 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-c4b508d2-ebc0-4371-bb5c-d3b768cf342e tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] 10.222.0.26 "GET /compute/v2.1/servers/c24fee69-5bf4-40f4-ba18-56aecd12dd96" status: 200 len: 1520 microversion: 2.1 time: 0.225642 Mar 05 02:53:58.728720 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 96/197] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:53:58 2022] GET /compute/v2.1/servers/c24fee69-5bf4-40f4-ba18-56aecd12dd96 => generated 1520 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 02:53:58.728720 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-8d3ef9d1-711f-4607-a895-e7caa29dc8d7 tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:53:58.728720 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-8d3ef9d1-711f-4607-a895-e7caa29dc8d7 tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] [instance: 1330ae1f-2dd0-436c-bbaa-c3c2d711fb83] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:53:58.731962 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-8d3ef9d1-711f-4607-a895-e7caa29dc8d7 tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:53:58.732361 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-8d3ef9d1-711f-4607-a895-e7caa29dc8d7 tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:53:58.733593 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-0aa2cb8f-a525-49c3-a847-fad36d10ccf4 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:53:58.734861 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-8d3ef9d1-711f-4607-a895-e7caa29dc8d7 tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:53:58.735598 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-8d3ef9d1-711f-4607-a895-e7caa29dc8d7 tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:53:58.752926 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-0aa2cb8f-a525-49c3-a847-fad36d10ccf4 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:53:58.754476 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-0aa2cb8f-a525-49c3-a847-fad36d10ccf4 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:53:58.755780 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-0aa2cb8f-a525-49c3-a847-fad36d10ccf4 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] 10.222.0.26 "GET /compute/v2.1/servers/e28e570d-3d50-4fe8-bb4a-fe0e95c20fb7" status: 200 len: 1723 microversion: 2.20 time: 0.250602 Mar 05 02:53:58.762979 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 102/198] 10.222.0.26 () {60 vars in 1276 bytes} [Sat Mar 5 02:53:58 2022] GET /compute/v2.1/servers/e28e570d-3d50-4fe8-bb4a-fe0e95c20fb7 => generated 1723 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 05 02:53:58.890230 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-8d3ef9d1-711f-4607-a895-e7caa29dc8d7 tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1700aa8052b94f878886b08f94f05831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3afb5b14217e4a54ab03e6233f8aaa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:53:58.898729 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-8d3ef9d1-711f-4607-a895-e7caa29dc8d7 tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] 10.222.0.26 "GET /compute/v2.1/servers/1330ae1f-2dd0-436c-bbaa-c3c2d711fb83" status: 200 len: 1314 microversion: 2.1 time: 0.177085 Mar 05 02:53:58.898729 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 97/199] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:53:58 2022] GET /compute/v2.1/servers/1330ae1f-2dd0-436c-bbaa-c3c2d711fb83 => generated 1314 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 02:53:59.736731 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-e1c4ee2d-4c65-450a-85c6-8d96cb2fb1bc tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:53:59.737355 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-e1c4ee2d-4c65-450a-85c6-8d96cb2fb1bc tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] [instance: c24fee69-5bf4-40f4-ba18-56aecd12dd96] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:53:59.743477 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-e1c4ee2d-4c65-450a-85c6-8d96cb2fb1bc tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:53:59.743931 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-e1c4ee2d-4c65-450a-85c6-8d96cb2fb1bc tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:53:59.744713 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-e1c4ee2d-4c65-450a-85c6-8d96cb2fb1bc tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:53:59.745155 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-e1c4ee2d-4c65-450a-85c6-8d96cb2fb1bc tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:53:59.774853 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-737dc209-d5ac-4cbf-bcae-cd7b7814dddb tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:53:59.775462 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-737dc209-d5ac-4cbf-bcae-cd7b7814dddb tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] [instance: e28e570d-3d50-4fe8-bb4a-fe0e95c20fb7] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:53:59.783204 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-737dc209-d5ac-4cbf-bcae-cd7b7814dddb tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:53:59.783655 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-737dc209-d5ac-4cbf-bcae-cd7b7814dddb tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:53:59.784445 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-737dc209-d5ac-4cbf-bcae-cd7b7814dddb tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:53:59.784883 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-737dc209-d5ac-4cbf-bcae-cd7b7814dddb tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:53:59.932071 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-e1c4ee2d-4c65-450a-85c6-8d96cb2fb1bc tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90033e5e8e634b699bf050e36519f8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8112a5759c444c1f94be24ab61bf072f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:53:59.940990 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-e1c4ee2d-4c65-450a-85c6-8d96cb2fb1bc tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] 10.222.0.26 "GET /compute/v2.1/servers/c24fee69-5bf4-40f4-ba18-56aecd12dd96" status: 200 len: 1520 microversion: 2.1 time: 0.208828 Mar 05 02:53:59.941786 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 103/200] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:53:59 2022] GET /compute/v2.1/servers/c24fee69-5bf4-40f4-ba18-56aecd12dd96 => generated 1520 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 02:53:59.946631 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-6bfcb539-e467-4360-aa78-95c47e3d00f7 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0ec89b5f-bb9d-481f-a640-699f48b2c64c"}} {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 02:53:59.947751 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-6bfcb539-e467-4360-aa78-95c47e3d00f7 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] [instance: d0080e4b-6532-4e0c-8d19-cfbdf32e401b] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:53:59.955324 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-6bfcb539-e467-4360-aa78-95c47e3d00f7 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:53:59.956042 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-6bfcb539-e467-4360-aa78-95c47e3d00f7 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:53:59.956829 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-6bfcb539-e467-4360-aa78-95c47e3d00f7 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:53:59.957272 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-6bfcb539-e467-4360-aa78-95c47e3d00f7 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:53:59.989051 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-737dc209-d5ac-4cbf-bcae-cd7b7814dddb tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:53:59.998596 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-737dc209-d5ac-4cbf-bcae-cd7b7814dddb tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:54:00.000238 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-737dc209-d5ac-4cbf-bcae-cd7b7814dddb tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:54:00.001860 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-737dc209-d5ac-4cbf-bcae-cd7b7814dddb tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] 10.222.0.26 "GET /compute/v2.1/servers/e28e570d-3d50-4fe8-bb4a-fe0e95c20fb7" status: 200 len: 1723 microversion: 2.20 time: 0.230881 Mar 05 02:54:00.009513 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 98/201] 10.222.0.26 () {60 vars in 1276 bytes} [Sat Mar 5 02:53:59 2022] GET /compute/v2.1/servers/e28e570d-3d50-4fe8-bb4a-fe0e95c20fb7 => generated 1723 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 05 02:54:00.009513 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-49adaadd-5cbd-42eb-bed4-1c68ca6b0a77 tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:54:00.009513 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-49adaadd-5cbd-42eb-bed4-1c68ca6b0a77 tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] [instance: 1330ae1f-2dd0-436c-bbaa-c3c2d711fb83] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:54:00.014001 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-49adaadd-5cbd-42eb-bed4-1c68ca6b0a77 tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:00.014498 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-49adaadd-5cbd-42eb-bed4-1c68ca6b0a77 tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:00.015282 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-49adaadd-5cbd-42eb-bed4-1c68ca6b0a77 tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:00.015788 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-49adaadd-5cbd-42eb-bed4-1c68ca6b0a77 tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:00.206088 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-49adaadd-5cbd-42eb-bed4-1c68ca6b0a77 tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1700aa8052b94f878886b08f94f05831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3afb5b14217e4a54ab03e6233f8aaa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:54:00.213703 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-49adaadd-5cbd-42eb-bed4-1c68ca6b0a77 tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] 10.222.0.26 "GET /compute/v2.1/servers/1330ae1f-2dd0-436c-bbaa-c3c2d711fb83" status: 200 len: 1314 microversion: 2.1 time: 0.209745 Mar 05 02:54:00.214489 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 99/202] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:54:00 2022] GET /compute/v2.1/servers/1330ae1f-2dd0-436c-bbaa-c3c2d711fb83 => generated 1314 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 02:54:00.228045 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [req-dd2d2c67-bbd3-452f-b559-6f00ca5150de req-e0267859-24b1-4006-8e23-fe3feb7480d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1330ae1f-2dd0-436c-bbaa-c3c2d711fb83", "name": "network-vif-plugged", "status": "completed", "tag": "9fad6e24-25a4-407a-bdaf-607bca1d98a2"}]} {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 02:54:00.237695 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [req-dd2d2c67-bbd3-452f-b559-6f00ca5150de req-e0267859-24b1-4006-8e23-fe3feb7480d0 service nova] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:00.238081 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [req-dd2d2c67-bbd3-452f-b559-6f00ca5150de req-e0267859-24b1-4006-8e23-fe3feb7480d0 service nova] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:00.250540 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.compute.server_external_events [req-dd2d2c67-bbd3-452f-b559-6f00ca5150de req-e0267859-24b1-4006-8e23-fe3feb7480d0 service nova] Creating event network-vif-plugged:9fad6e24-25a4-407a-bdaf-607bca1d98a2 for instance 1330ae1f-2dd0-436c-bbaa-c3c2d711fb83 on hv-cinder-82725 Mar 05 02:54:00.254808 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-6bfcb539-e467-4360-aa78-95c47e3d00f7 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] 10.222.0.26 "POST /compute/v2.1/servers/d0080e4b-6532-4e0c-8d19-cfbdf32e401b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.311446 Mar 05 02:54:00.255339 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [req-dd2d2c67-bbd3-452f-b559-6f00ca5150de req-e0267859-24b1-4006-8e23-fe3feb7480d0 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031060 Mar 05 02:54:00.259895 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 104/203] 10.222.0.26 () {60 vars in 1322 bytes} [Sat Mar 5 02:53:59 2022] POST /compute/v2.1/servers/d0080e4b-6532-4e0c-8d19-cfbdf32e401b/os-volume_attachments => generated 194 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 02:54:00.260402 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 100/204] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Mar 5 02:54:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 02:54:00.960526 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-bda6bfd3-ee8a-4e70-9996-670d7f63775a tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:54:00.961352 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-bda6bfd3-ee8a-4e70-9996-670d7f63775a tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] [instance: c24fee69-5bf4-40f4-ba18-56aecd12dd96] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:54:00.971158 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-bda6bfd3-ee8a-4e70-9996-670d7f63775a tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:00.971643 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-bda6bfd3-ee8a-4e70-9996-670d7f63775a tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:00.972407 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-bda6bfd3-ee8a-4e70-9996-670d7f63775a tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:00.972834 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-bda6bfd3-ee8a-4e70-9996-670d7f63775a tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:01.024028 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-937c6d30-6d78-4f62-ab55-6424e8d7d12d tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:54:01.024737 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-937c6d30-6d78-4f62-ab55-6424e8d7d12d tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] [instance: e28e570d-3d50-4fe8-bb4a-fe0e95c20fb7] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:54:01.031147 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-937c6d30-6d78-4f62-ab55-6424e8d7d12d tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:01.031603 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-937c6d30-6d78-4f62-ab55-6424e8d7d12d tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:01.032384 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-937c6d30-6d78-4f62-ab55-6424e8d7d12d tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:01.032828 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-937c6d30-6d78-4f62-ab55-6424e8d7d12d tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:01.140548 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-bda6bfd3-ee8a-4e70-9996-670d7f63775a tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90033e5e8e634b699bf050e36519f8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8112a5759c444c1f94be24ab61bf072f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:54:01.147786 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-bda6bfd3-ee8a-4e70-9996-670d7f63775a tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] 10.222.0.26 "GET /compute/v2.1/servers/c24fee69-5bf4-40f4-ba18-56aecd12dd96" status: 200 len: 1520 microversion: 2.1 time: 0.193286 Mar 05 02:54:01.148349 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 105/205] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:54:00 2022] GET /compute/v2.1/servers/c24fee69-5bf4-40f4-ba18-56aecd12dd96 => generated 1520 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 02:54:01.199766 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-937c6d30-6d78-4f62-ab55-6424e8d7d12d tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:54:01.207810 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-937c6d30-6d78-4f62-ab55-6424e8d7d12d tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:54:01.209251 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-937c6d30-6d78-4f62-ab55-6424e8d7d12d tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:54:01.210553 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-937c6d30-6d78-4f62-ab55-6424e8d7d12d tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] 10.222.0.26 "GET /compute/v2.1/servers/e28e570d-3d50-4fe8-bb4a-fe0e95c20fb7" status: 200 len: 1723 microversion: 2.20 time: 0.194120 Mar 05 02:54:01.211116 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 101/206] 10.222.0.26 () {60 vars in 1276 bytes} [Sat Mar 5 02:54:01 2022] GET /compute/v2.1/servers/e28e570d-3d50-4fe8-bb4a-fe0e95c20fb7 => generated 1723 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 05 02:54:01.231346 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-4b456424-f9a9-441a-9624-ccc0c73d035a tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:54:01.231951 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-4b456424-f9a9-441a-9624-ccc0c73d035a tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] [instance: 1330ae1f-2dd0-436c-bbaa-c3c2d711fb83] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:54:01.238477 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-4b456424-f9a9-441a-9624-ccc0c73d035a tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:01.238924 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-4b456424-f9a9-441a-9624-ccc0c73d035a tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:01.239685 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-4b456424-f9a9-441a-9624-ccc0c73d035a tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:01.240117 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-4b456424-f9a9-441a-9624-ccc0c73d035a tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:01.384186 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-4b456424-f9a9-441a-9624-ccc0c73d035a tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1700aa8052b94f878886b08f94f05831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3afb5b14217e4a54ab03e6233f8aaa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:54:01.394148 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-4b456424-f9a9-441a-9624-ccc0c73d035a tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] 10.222.0.26 "GET /compute/v2.1/servers/1330ae1f-2dd0-436c-bbaa-c3c2d711fb83" status: 200 len: 1314 microversion: 2.1 time: 0.166790 Mar 05 02:54:01.394728 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 106/207] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:54:01 2022] GET /compute/v2.1/servers/1330ae1f-2dd0-436c-bbaa-c3c2d711fb83 => generated 1314 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 02:54:02.165837 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-46b5d381-b11c-408a-b055-16301b79dc52 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:54:02.166579 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-46b5d381-b11c-408a-b055-16301b79dc52 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] [instance: c24fee69-5bf4-40f4-ba18-56aecd12dd96] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:54:02.174278 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-46b5d381-b11c-408a-b055-16301b79dc52 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:02.174735 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-46b5d381-b11c-408a-b055-16301b79dc52 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:02.175516 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-46b5d381-b11c-408a-b055-16301b79dc52 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:02.176021 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-46b5d381-b11c-408a-b055-16301b79dc52 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:02.229137 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-23822b87-9dbe-4cf3-be66-f3796b09d111 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:54:02.229929 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-23822b87-9dbe-4cf3-be66-f3796b09d111 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] [instance: e28e570d-3d50-4fe8-bb4a-fe0e95c20fb7] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:54:02.237146 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-23822b87-9dbe-4cf3-be66-f3796b09d111 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:02.237607 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-23822b87-9dbe-4cf3-be66-f3796b09d111 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:02.238419 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-23822b87-9dbe-4cf3-be66-f3796b09d111 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:02.239254 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-23822b87-9dbe-4cf3-be66-f3796b09d111 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:02.360109 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-46b5d381-b11c-408a-b055-16301b79dc52 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90033e5e8e634b699bf050e36519f8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8112a5759c444c1f94be24ab61bf072f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:54:02.370969 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-46b5d381-b11c-408a-b055-16301b79dc52 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] 10.222.0.26 "GET /compute/v2.1/servers/c24fee69-5bf4-40f4-ba18-56aecd12dd96" status: 200 len: 1520 microversion: 2.1 time: 0.209311 Mar 05 02:54:02.380697 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 102/208] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:54:02 2022] GET /compute/v2.1/servers/c24fee69-5bf4-40f4-ba18-56aecd12dd96 => generated 1520 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 02:54:02.412758 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-93ddd750-d382-4eca-ad4a-30ce9194134b tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:54:02.413682 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-93ddd750-d382-4eca-ad4a-30ce9194134b tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] [instance: 1330ae1f-2dd0-436c-bbaa-c3c2d711fb83] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:54:02.429716 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-93ddd750-d382-4eca-ad4a-30ce9194134b tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:02.430206 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-93ddd750-d382-4eca-ad4a-30ce9194134b tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:02.431093 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-93ddd750-d382-4eca-ad4a-30ce9194134b tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:02.431538 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-93ddd750-d382-4eca-ad4a-30ce9194134b tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:02.440558 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-23822b87-9dbe-4cf3-be66-f3796b09d111 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:54:02.448683 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-23822b87-9dbe-4cf3-be66-f3796b09d111 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:54:02.450343 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-23822b87-9dbe-4cf3-be66-f3796b09d111 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:54:02.452034 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-23822b87-9dbe-4cf3-be66-f3796b09d111 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] 10.222.0.26 "GET /compute/v2.1/servers/e28e570d-3d50-4fe8-bb4a-fe0e95c20fb7" status: 200 len: 1723 microversion: 2.20 time: 0.226464 Mar 05 02:54:02.453238 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 107/209] 10.222.0.26 () {60 vars in 1276 bytes} [Sat Mar 5 02:54:02 2022] GET /compute/v2.1/servers/e28e570d-3d50-4fe8-bb4a-fe0e95c20fb7 => generated 1723 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 05 02:54:02.570695 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-93ddd750-d382-4eca-ad4a-30ce9194134b tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1700aa8052b94f878886b08f94f05831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3afb5b14217e4a54ab03e6233f8aaa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:54:02.578572 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-93ddd750-d382-4eca-ad4a-30ce9194134b tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] 10.222.0.26 "GET /compute/v2.1/servers/1330ae1f-2dd0-436c-bbaa-c3c2d711fb83" status: 200 len: 1498 microversion: 2.1 time: 0.171531 Mar 05 02:54:02.579186 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 103/210] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:54:02 2022] GET /compute/v2.1/servers/1330ae1f-2dd0-436c-bbaa-c3c2d711fb83 => generated 1498 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 02:54:03.117257 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-b6aaf8c0-b310-4d81-9e0b-23907d0796ac tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:54:03.117881 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-b6aaf8c0-b310-4d81-9e0b-23907d0796ac tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] [instance: 1330ae1f-2dd0-436c-bbaa-c3c2d711fb83] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:54:03.124814 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-b6aaf8c0-b310-4d81-9e0b-23907d0796ac tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:03.125707 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-b6aaf8c0-b310-4d81-9e0b-23907d0796ac tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:03.126598 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-b6aaf8c0-b310-4d81-9e0b-23907d0796ac tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:03.127189 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-b6aaf8c0-b310-4d81-9e0b-23907d0796ac tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:03.155571 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-b6aaf8c0-b310-4d81-9e0b-23907d0796ac tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] [instance: 1330ae1f-2dd0-436c-bbaa-c3c2d711fb83] Going to try to terminate instance {{(pid=123545) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 05 02:54:03.233995 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-b6aaf8c0-b310-4d81-9e0b-23907d0796ac tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] 10.222.0.26 "DELETE /compute/v2.1/servers/1330ae1f-2dd0-436c-bbaa-c3c2d711fb83" status: 204 len: 0 microversion: 2.1 time: 0.120641 Mar 05 02:54:03.235112 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 108/211] 10.222.0.26 () {58 vars in 1238 bytes} [Sat Mar 5 02:54:03 2022] DELETE /compute/v2.1/servers/1330ae1f-2dd0-436c-bbaa-c3c2d711fb83 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 05 02:54:03.243429 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-8692b5b1-cb1c-443e-aeae-56f64d74917f tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:54:03.244028 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-8692b5b1-cb1c-443e-aeae-56f64d74917f tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] [instance: 1330ae1f-2dd0-436c-bbaa-c3c2d711fb83] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:54:03.251137 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-8692b5b1-cb1c-443e-aeae-56f64d74917f tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:03.251621 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-8692b5b1-cb1c-443e-aeae-56f64d74917f tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:03.252390 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-8692b5b1-cb1c-443e-aeae-56f64d74917f tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:03.252819 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-8692b5b1-cb1c-443e-aeae-56f64d74917f tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:03.389017 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-392d4b13-e2ba-4bda-be92-2e6026fff031 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:54:03.390025 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-392d4b13-e2ba-4bda-be92-2e6026fff031 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] [instance: c24fee69-5bf4-40f4-ba18-56aecd12dd96] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:54:03.397841 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-392d4b13-e2ba-4bda-be92-2e6026fff031 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:03.398324 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-392d4b13-e2ba-4bda-be92-2e6026fff031 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:03.399105 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-392d4b13-e2ba-4bda-be92-2e6026fff031 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:03.399725 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-392d4b13-e2ba-4bda-be92-2e6026fff031 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:03.408770 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-8692b5b1-cb1c-443e-aeae-56f64d74917f tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1700aa8052b94f878886b08f94f05831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3afb5b14217e4a54ab03e6233f8aaa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:54:03.417692 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-8692b5b1-cb1c-443e-aeae-56f64d74917f tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] 10.222.0.26 "GET /compute/v2.1/servers/1330ae1f-2dd0-436c-bbaa-c3c2d711fb83" status: 200 len: 1504 microversion: 2.1 time: 0.177912 Mar 05 02:54:03.418887 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 104/212] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:54:03 2022] GET /compute/v2.1/servers/1330ae1f-2dd0-436c-bbaa-c3c2d711fb83 => generated 1504 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 02:54:03.472775 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-b7f8a224-05d4-4efd-ba51-d08b176d2054 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:54:03.473660 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-b7f8a224-05d4-4efd-ba51-d08b176d2054 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] [instance: e28e570d-3d50-4fe8-bb4a-fe0e95c20fb7] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:54:03.484219 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-b7f8a224-05d4-4efd-ba51-d08b176d2054 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:03.485889 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-b7f8a224-05d4-4efd-ba51-d08b176d2054 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:03.490041 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-b7f8a224-05d4-4efd-ba51-d08b176d2054 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:03.491604 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-b7f8a224-05d4-4efd-ba51-d08b176d2054 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:03.605265 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-392d4b13-e2ba-4bda-be92-2e6026fff031 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90033e5e8e634b699bf050e36519f8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8112a5759c444c1f94be24ab61bf072f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:54:03.613716 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-392d4b13-e2ba-4bda-be92-2e6026fff031 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] 10.222.0.26 "GET /compute/v2.1/servers/c24fee69-5bf4-40f4-ba18-56aecd12dd96" status: 200 len: 1520 microversion: 2.1 time: 0.228894 Mar 05 02:54:03.614848 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 109/213] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:54:03 2022] GET /compute/v2.1/servers/c24fee69-5bf4-40f4-ba18-56aecd12dd96 => generated 1520 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 02:54:03.689783 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-b7f8a224-05d4-4efd-ba51-d08b176d2054 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:54:03.697823 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-b7f8a224-05d4-4efd-ba51-d08b176d2054 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:54:03.699373 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-b7f8a224-05d4-4efd-ba51-d08b176d2054 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:54:03.700539 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-b7f8a224-05d4-4efd-ba51-d08b176d2054 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] 10.222.0.26 "GET /compute/v2.1/servers/e28e570d-3d50-4fe8-bb4a-fe0e95c20fb7" status: 200 len: 1723 microversion: 2.20 time: 0.233216 Mar 05 02:54:03.701109 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 105/214] 10.222.0.26 () {60 vars in 1276 bytes} [Sat Mar 5 02:54:03 2022] GET /compute/v2.1/servers/e28e570d-3d50-4fe8-bb4a-fe0e95c20fb7 => generated 1723 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 02:54:04.436458 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-0d11ec82-9d25-4918-85ca-5adf4c281de1 tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:54:04.437791 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-0d11ec82-9d25-4918-85ca-5adf4c281de1 tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] [instance: 1330ae1f-2dd0-436c-bbaa-c3c2d711fb83] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:54:04.465195 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-0d11ec82-9d25-4918-85ca-5adf4c281de1 tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:04.466095 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-0d11ec82-9d25-4918-85ca-5adf4c281de1 tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:04.471733 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-0d11ec82-9d25-4918-85ca-5adf4c281de1 tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:04.474262 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-0d11ec82-9d25-4918-85ca-5adf4c281de1 tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:04.635453 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-0d11ec82-9d25-4918-85ca-5adf4c281de1 tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1700aa8052b94f878886b08f94f05831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3afb5b14217e4a54ab03e6233f8aaa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:54:04.636568 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-43aa3d4e-8cc5-4a36-907b-d2adbef404e1 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:54:04.637310 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-43aa3d4e-8cc5-4a36-907b-d2adbef404e1 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] [instance: c24fee69-5bf4-40f4-ba18-56aecd12dd96] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:54:04.643576 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-43aa3d4e-8cc5-4a36-907b-d2adbef404e1 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:04.643998 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-0d11ec82-9d25-4918-85ca-5adf4c281de1 tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] 10.222.0.26 "GET /compute/v2.1/servers/1330ae1f-2dd0-436c-bbaa-c3c2d711fb83" status: 200 len: 1504 microversion: 2.1 time: 0.211723 Mar 05 02:54:04.644248 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-43aa3d4e-8cc5-4a36-907b-d2adbef404e1 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:04.644768 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 110/215] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:54:04 2022] GET /compute/v2.1/servers/1330ae1f-2dd0-436c-bbaa-c3c2d711fb83 => generated 1504 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 02:54:04.645980 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-43aa3d4e-8cc5-4a36-907b-d2adbef404e1 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:04.646639 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-43aa3d4e-8cc5-4a36-907b-d2adbef404e1 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:04.719208 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-9aa297f3-3131-4822-99bd-5abc69c2dc86 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:54:04.719999 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-9aa297f3-3131-4822-99bd-5abc69c2dc86 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] [instance: e28e570d-3d50-4fe8-bb4a-fe0e95c20fb7] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:54:04.736047 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-9aa297f3-3131-4822-99bd-5abc69c2dc86 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:04.736936 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-9aa297f3-3131-4822-99bd-5abc69c2dc86 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:04.738257 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-9aa297f3-3131-4822-99bd-5abc69c2dc86 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:04.739358 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-9aa297f3-3131-4822-99bd-5abc69c2dc86 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:04.880215 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-43aa3d4e-8cc5-4a36-907b-d2adbef404e1 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90033e5e8e634b699bf050e36519f8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8112a5759c444c1f94be24ab61bf072f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:54:04.889788 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-43aa3d4e-8cc5-4a36-907b-d2adbef404e1 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] 10.222.0.26 "GET /compute/v2.1/servers/c24fee69-5bf4-40f4-ba18-56aecd12dd96" status: 200 len: 1520 microversion: 2.1 time: 0.258548 Mar 05 02:54:04.890445 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 106/216] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:54:04 2022] GET /compute/v2.1/servers/c24fee69-5bf4-40f4-ba18-56aecd12dd96 => generated 1520 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 02:54:04.962947 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-9aa297f3-3131-4822-99bd-5abc69c2dc86 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:54:04.974233 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-9aa297f3-3131-4822-99bd-5abc69c2dc86 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:54:04.976376 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-9aa297f3-3131-4822-99bd-5abc69c2dc86 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:54:04.978050 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-9aa297f3-3131-4822-99bd-5abc69c2dc86 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] 10.222.0.26 "GET /compute/v2.1/servers/e28e570d-3d50-4fe8-bb4a-fe0e95c20fb7" status: 200 len: 1723 microversion: 2.20 time: 0.262967 Mar 05 02:54:04.990932 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 111/217] 10.222.0.26 () {60 vars in 1276 bytes} [Sat Mar 5 02:54:04 2022] GET /compute/v2.1/servers/e28e570d-3d50-4fe8-bb4a-fe0e95c20fb7 => generated 1723 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 02:54:05.665796 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-26e445fc-976a-45fe-9647-e25b77d7b647 tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:54:05.666597 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-26e445fc-976a-45fe-9647-e25b77d7b647 tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] [instance: 1330ae1f-2dd0-436c-bbaa-c3c2d711fb83] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:54:05.690778 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-26e445fc-976a-45fe-9647-e25b77d7b647 tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:05.691225 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-26e445fc-976a-45fe-9647-e25b77d7b647 tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:05.692020 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-26e445fc-976a-45fe-9647-e25b77d7b647 tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:05.692454 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-26e445fc-976a-45fe-9647-e25b77d7b647 tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:05.870772 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-26e445fc-976a-45fe-9647-e25b77d7b647 tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1700aa8052b94f878886b08f94f05831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3afb5b14217e4a54ab03e6233f8aaa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:54:05.907091 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-e253f551-a627-4c9d-bfb1-0e070ddfc4dc tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:54:05.908378 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-e253f551-a627-4c9d-bfb1-0e070ddfc4dc tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] [instance: c24fee69-5bf4-40f4-ba18-56aecd12dd96] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:54:05.912575 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-26e445fc-976a-45fe-9647-e25b77d7b647 tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] 10.222.0.26 "GET /compute/v2.1/servers/1330ae1f-2dd0-436c-bbaa-c3c2d711fb83" status: 200 len: 1504 microversion: 2.1 time: 0.254330 Mar 05 02:54:05.916930 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 107/218] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:54:05 2022] GET /compute/v2.1/servers/1330ae1f-2dd0-436c-bbaa-c3c2d711fb83 => generated 1504 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 02:54:05.917268 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-e253f551-a627-4c9d-bfb1-0e070ddfc4dc tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:05.918054 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-e253f551-a627-4c9d-bfb1-0e070ddfc4dc tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:05.919057 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-e253f551-a627-4c9d-bfb1-0e070ddfc4dc tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:05.919708 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-e253f551-a627-4c9d-bfb1-0e070ddfc4dc tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:06.000133 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-b582b207-8995-4d49-ad48-e9a999df881f tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:54:06.001223 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-b582b207-8995-4d49-ad48-e9a999df881f tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] [instance: e28e570d-3d50-4fe8-bb4a-fe0e95c20fb7] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:54:06.011085 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-b582b207-8995-4d49-ad48-e9a999df881f tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:06.011800 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-b582b207-8995-4d49-ad48-e9a999df881f tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:06.015009 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-b582b207-8995-4d49-ad48-e9a999df881f tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:06.015696 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-b582b207-8995-4d49-ad48-e9a999df881f tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:06.243669 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-e253f551-a627-4c9d-bfb1-0e070ddfc4dc tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90033e5e8e634b699bf050e36519f8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8112a5759c444c1f94be24ab61bf072f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:54:06.252470 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-e253f551-a627-4c9d-bfb1-0e070ddfc4dc tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] 10.222.0.26 "GET /compute/v2.1/servers/c24fee69-5bf4-40f4-ba18-56aecd12dd96" status: 200 len: 1520 microversion: 2.1 time: 0.350021 Mar 05 02:54:06.253347 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 112/219] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:54:05 2022] GET /compute/v2.1/servers/c24fee69-5bf4-40f4-ba18-56aecd12dd96 => generated 1520 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 02:54:06.269229 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [req-e90e2546-b017-46f1-b51f-2b43f28458ae req-852ce25a-9c67-47dc-8fff-5ae4c0f72d70 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1330ae1f-2dd0-436c-bbaa-c3c2d711fb83", "name": "network-vif-deleted", "tag": "9fad6e24-25a4-407a-bdaf-607bca1d98a2"}]} {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 02:54:06.282395 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [req-e90e2546-b017-46f1-b51f-2b43f28458ae req-852ce25a-9c67-47dc-8fff-5ae4c0f72d70 service nova] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:06.283107 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [req-e90e2546-b017-46f1-b51f-2b43f28458ae req-852ce25a-9c67-47dc-8fff-5ae4c0f72d70 service nova] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:06.302196 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.compute.server_external_events [req-e90e2546-b017-46f1-b51f-2b43f28458ae req-852ce25a-9c67-47dc-8fff-5ae4c0f72d70 service nova] Creating event network-vif-deleted:9fad6e24-25a4-407a-bdaf-607bca1d98a2 for instance 1330ae1f-2dd0-436c-bbaa-c3c2d711fb83 on hv-cinder-82725 Mar 05 02:54:06.309834 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [req-e90e2546-b017-46f1-b51f-2b43f28458ae req-852ce25a-9c67-47dc-8fff-5ae4c0f72d70 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045246 Mar 05 02:54:06.311592 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 113/220] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Mar 5 02:54:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 02:54:06.361917 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-b582b207-8995-4d49-ad48-e9a999df881f tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:54:06.370482 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-b582b207-8995-4d49-ad48-e9a999df881f tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:54:06.372004 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-b582b207-8995-4d49-ad48-e9a999df881f tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:54:06.373175 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-b582b207-8995-4d49-ad48-e9a999df881f tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] 10.222.0.26 "GET /compute/v2.1/servers/e28e570d-3d50-4fe8-bb4a-fe0e95c20fb7" status: 200 len: 1723 microversion: 2.20 time: 0.377654 Mar 05 02:54:06.374393 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 108/221] 10.222.0.26 () {60 vars in 1276 bytes} [Sat Mar 5 02:54:05 2022] GET /compute/v2.1/servers/e28e570d-3d50-4fe8-bb4a-fe0e95c20fb7 => generated 1723 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 02:54:06.934364 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-7262713b-487d-4a6d-8d81-3532bd49f867 tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:54:06.935113 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-7262713b-487d-4a6d-8d81-3532bd49f867 tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] [instance: 1330ae1f-2dd0-436c-bbaa-c3c2d711fb83] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:54:06.949982 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-7262713b-487d-4a6d-8d81-3532bd49f867 tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:06.950673 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-7262713b-487d-4a6d-8d81-3532bd49f867 tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:06.951680 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-7262713b-487d-4a6d-8d81-3532bd49f867 tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:06.958935 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-7262713b-487d-4a6d-8d81-3532bd49f867 tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:07.069818 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-7262713b-487d-4a6d-8d81-3532bd49f867 tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1700aa8052b94f878886b08f94f05831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3afb5b14217e4a54ab03e6233f8aaa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:54:07.087748 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-7262713b-487d-4a6d-8d81-3532bd49f867 tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] 10.222.0.26 "GET /compute/v2.1/servers/1330ae1f-2dd0-436c-bbaa-c3c2d711fb83" status: 200 len: 1462 microversion: 2.1 time: 0.157775 Mar 05 02:54:07.091927 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 114/222] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:54:06 2022] GET /compute/v2.1/servers/1330ae1f-2dd0-436c-bbaa-c3c2d711fb83 => generated 1462 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 02:54:07.270686 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-dcd4c856-3620-44b8-b37e-b8a5d524f495 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:54:07.272111 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-dcd4c856-3620-44b8-b37e-b8a5d524f495 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] [instance: c24fee69-5bf4-40f4-ba18-56aecd12dd96] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:54:07.279279 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-dcd4c856-3620-44b8-b37e-b8a5d524f495 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:07.280532 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-dcd4c856-3620-44b8-b37e-b8a5d524f495 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:07.281516 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-dcd4c856-3620-44b8-b37e-b8a5d524f495 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:07.281944 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-dcd4c856-3620-44b8-b37e-b8a5d524f495 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:07.394815 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-59f9faeb-7b63-4dc3-8ac6-9bbdc824066b tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:54:07.396292 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-59f9faeb-7b63-4dc3-8ac6-9bbdc824066b tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] [instance: e28e570d-3d50-4fe8-bb4a-fe0e95c20fb7] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:54:07.409613 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-59f9faeb-7b63-4dc3-8ac6-9bbdc824066b tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:07.410144 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-59f9faeb-7b63-4dc3-8ac6-9bbdc824066b tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:07.410934 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-59f9faeb-7b63-4dc3-8ac6-9bbdc824066b tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:07.411510 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-59f9faeb-7b63-4dc3-8ac6-9bbdc824066b tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:07.600952 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-dcd4c856-3620-44b8-b37e-b8a5d524f495 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90033e5e8e634b699bf050e36519f8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8112a5759c444c1f94be24ab61bf072f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:54:07.610587 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-dcd4c856-3620-44b8-b37e-b8a5d524f495 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] 10.222.0.26 "GET /compute/v2.1/servers/c24fee69-5bf4-40f4-ba18-56aecd12dd96" status: 200 len: 1520 microversion: 2.1 time: 0.343766 Mar 05 02:54:07.613419 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 109/223] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:54:07 2022] GET /compute/v2.1/servers/c24fee69-5bf4-40f4-ba18-56aecd12dd96 => generated 1520 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 02:54:07.760741 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-59f9faeb-7b63-4dc3-8ac6-9bbdc824066b tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:54:07.772461 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-59f9faeb-7b63-4dc3-8ac6-9bbdc824066b tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:54:07.774359 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-59f9faeb-7b63-4dc3-8ac6-9bbdc824066b tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:54:07.777559 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-59f9faeb-7b63-4dc3-8ac6-9bbdc824066b tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] 10.222.0.26 "GET /compute/v2.1/servers/e28e570d-3d50-4fe8-bb4a-fe0e95c20fb7" status: 200 len: 1723 microversion: 2.20 time: 0.387764 Mar 05 02:54:07.796249 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 115/224] 10.222.0.26 () {60 vars in 1276 bytes} [Sat Mar 5 02:54:07 2022] GET /compute/v2.1/servers/e28e570d-3d50-4fe8-bb4a-fe0e95c20fb7 => generated 1723 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 02:54:08.108377 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-0ba4bc5a-d455-4aff-ace3-08551b376205 tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:54:08.108978 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-0ba4bc5a-d455-4aff-ace3-08551b376205 tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] [instance: 1330ae1f-2dd0-436c-bbaa-c3c2d711fb83] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:54:08.116051 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-0ba4bc5a-d455-4aff-ace3-08551b376205 tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:08.116500 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-0ba4bc5a-d455-4aff-ace3-08551b376205 tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:08.117371 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-0ba4bc5a-d455-4aff-ace3-08551b376205 tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:08.117798 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-0ba4bc5a-d455-4aff-ace3-08551b376205 tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:08.188291 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-0ba4bc5a-d455-4aff-ace3-08551b376205 tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1700aa8052b94f878886b08f94f05831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3afb5b14217e4a54ab03e6233f8aaa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:54:08.207337 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-0ba4bc5a-d455-4aff-ace3-08551b376205 tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] 10.222.0.26 "GET /compute/v2.1/servers/1330ae1f-2dd0-436c-bbaa-c3c2d711fb83" status: 200 len: 1299 microversion: 2.1 time: 0.103572 Mar 05 02:54:08.208447 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 110/225] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:54:08 2022] GET /compute/v2.1/servers/1330ae1f-2dd0-436c-bbaa-c3c2d711fb83 => generated 1299 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 02:54:08.627370 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-39e72af2-b2e6-42f7-a35c-02fa40c20d12 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:54:08.628572 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-39e72af2-b2e6-42f7-a35c-02fa40c20d12 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] [instance: c24fee69-5bf4-40f4-ba18-56aecd12dd96] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:54:08.634939 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-39e72af2-b2e6-42f7-a35c-02fa40c20d12 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:08.635393 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-39e72af2-b2e6-42f7-a35c-02fa40c20d12 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:08.636160 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-39e72af2-b2e6-42f7-a35c-02fa40c20d12 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:08.636600 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-39e72af2-b2e6-42f7-a35c-02fa40c20d12 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:08.814267 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-d4c94f50-13a2-4d4f-8319-c712b75b4712 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:54:08.823830 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-d4c94f50-13a2-4d4f-8319-c712b75b4712 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] [instance: e28e570d-3d50-4fe8-bb4a-fe0e95c20fb7] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:54:08.868278 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-d4c94f50-13a2-4d4f-8319-c712b75b4712 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:08.868855 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-d4c94f50-13a2-4d4f-8319-c712b75b4712 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:08.869752 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-d4c94f50-13a2-4d4f-8319-c712b75b4712 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:08.870229 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-d4c94f50-13a2-4d4f-8319-c712b75b4712 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:08.890010 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-39e72af2-b2e6-42f7-a35c-02fa40c20d12 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90033e5e8e634b699bf050e36519f8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8112a5759c444c1f94be24ab61bf072f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:54:08.898193 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-39e72af2-b2e6-42f7-a35c-02fa40c20d12 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] 10.222.0.26 "GET /compute/v2.1/servers/c24fee69-5bf4-40f4-ba18-56aecd12dd96" status: 200 len: 1520 microversion: 2.1 time: 0.274683 Mar 05 02:54:08.908965 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 116/226] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:54:08 2022] GET /compute/v2.1/servers/c24fee69-5bf4-40f4-ba18-56aecd12dd96 => generated 1520 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 02:54:09.105768 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-d4c94f50-13a2-4d4f-8319-c712b75b4712 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:54:09.116506 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-d4c94f50-13a2-4d4f-8319-c712b75b4712 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:54:09.118827 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-d4c94f50-13a2-4d4f-8319-c712b75b4712 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:54:09.120908 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-d4c94f50-13a2-4d4f-8319-c712b75b4712 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] 10.222.0.26 "GET /compute/v2.1/servers/e28e570d-3d50-4fe8-bb4a-fe0e95c20fb7" status: 200 len: 1723 microversion: 2.20 time: 0.327442 Mar 05 02:54:09.122184 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 111/227] 10.222.0.26 () {60 vars in 1276 bytes} [Sat Mar 5 02:54:08 2022] GET /compute/v2.1/servers/e28e570d-3d50-4fe8-bb4a-fe0e95c20fb7 => generated 1723 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 05 02:54:09.225456 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-12ba76a7-92f2-488b-aab5-d3cf638ea74b tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:54:09.226350 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-12ba76a7-92f2-488b-aab5-d3cf638ea74b tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] [instance: 1330ae1f-2dd0-436c-bbaa-c3c2d711fb83] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:54:09.234266 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-12ba76a7-92f2-488b-aab5-d3cf638ea74b tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:09.235037 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-12ba76a7-92f2-488b-aab5-d3cf638ea74b tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:09.236304 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-12ba76a7-92f2-488b-aab5-d3cf638ea74b tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:09.238001 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-12ba76a7-92f2-488b-aab5-d3cf638ea74b tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:09.294157 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-12ba76a7-92f2-488b-aab5-d3cf638ea74b tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:09.294885 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-12ba76a7-92f2-488b-aab5-d3cf638ea74b tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:09.296241 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.objects.instance [None req-12ba76a7-92f2-488b-aab5-d3cf638ea74b tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] Lazy-loading 'fault' on Instance uuid 1330ae1f-2dd0-436c-bbaa-c3c2d711fb83 {{(pid=123545) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 05 02:54:09.366634 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-12ba76a7-92f2-488b-aab5-d3cf638ea74b tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1700aa8052b94f878886b08f94f05831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3afb5b14217e4a54ab03e6233f8aaa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:54:09.375759 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-12ba76a7-92f2-488b-aab5-d3cf638ea74b tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] 10.222.0.26 "GET /compute/v2.1/servers/1330ae1f-2dd0-436c-bbaa-c3c2d711fb83" status: 200 len: 1304 microversion: 2.1 time: 0.154562 Mar 05 02:54:09.386723 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 117/228] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:54:09 2022] GET /compute/v2.1/servers/1330ae1f-2dd0-436c-bbaa-c3c2d711fb83 => generated 1304 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 02:54:09.916383 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-a6db7a1c-4e8a-4625-90dc-ffb7776ec8cb tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:54:09.917421 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-a6db7a1c-4e8a-4625-90dc-ffb7776ec8cb tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] [instance: c24fee69-5bf4-40f4-ba18-56aecd12dd96] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:54:09.925770 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-a6db7a1c-4e8a-4625-90dc-ffb7776ec8cb tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:09.926174 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-a6db7a1c-4e8a-4625-90dc-ffb7776ec8cb tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:09.936758 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-a6db7a1c-4e8a-4625-90dc-ffb7776ec8cb tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:09.937981 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-a6db7a1c-4e8a-4625-90dc-ffb7776ec8cb tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:10.140414 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-e3e7355b-c764-4d61-ae3a-836f77528bdf tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:54:10.141027 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-e3e7355b-c764-4d61-ae3a-836f77528bdf tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] [instance: e28e570d-3d50-4fe8-bb4a-fe0e95c20fb7] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:54:10.148876 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-e3e7355b-c764-4d61-ae3a-836f77528bdf tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:10.149344 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-e3e7355b-c764-4d61-ae3a-836f77528bdf tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:10.152968 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-e3e7355b-c764-4d61-ae3a-836f77528bdf tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:10.154307 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-e3e7355b-c764-4d61-ae3a-836f77528bdf tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:10.356070 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-a6db7a1c-4e8a-4625-90dc-ffb7776ec8cb tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90033e5e8e634b699bf050e36519f8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8112a5759c444c1f94be24ab61bf072f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:54:10.378327 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-a6db7a1c-4e8a-4625-90dc-ffb7776ec8cb tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] 10.222.0.26 "GET /compute/v2.1/servers/c24fee69-5bf4-40f4-ba18-56aecd12dd96" status: 200 len: 1520 microversion: 2.1 time: 0.465737 Mar 05 02:54:10.389968 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 112/229] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:54:09 2022] GET /compute/v2.1/servers/c24fee69-5bf4-40f4-ba18-56aecd12dd96 => generated 1520 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 02:54:10.396292 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-05742581-2b5d-4f81-9e8a-ce6d9f2a3f0f tempest-VolumesSnapshotTestJSON-729970751 tempest-VolumesSnapshotTestJSON-729970751-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-761164050", "imageRef": "adbc7df1-116e-4f9f-a28d-a6a3c084cceb", "flavorRef": "452", "networks": [{"uuid": "68be04e0-e340-4669-98a5-143d697647c0"}]}} {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 02:54:10.489541 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.network.neutron [None req-05742581-2b5d-4f81-9e8a-ce6d9f2a3f0f tempest-VolumesSnapshotTestJSON-729970751 tempest-VolumesSnapshotTestJSON-729970751-project] validate_networks() for [('68be04e0-e340-4669-98a5-143d697647c0', None, None, None, None, None)] {{(pid=123546) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 05 02:54:10.522889 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-e3e7355b-c764-4d61-ae3a-836f77528bdf tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:54:10.535187 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-e3e7355b-c764-4d61-ae3a-836f77528bdf tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:54:10.537167 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-e3e7355b-c764-4d61-ae3a-836f77528bdf tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:54:10.538639 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-e3e7355b-c764-4d61-ae3a-836f77528bdf tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] 10.222.0.26 "GET /compute/v2.1/servers/e28e570d-3d50-4fe8-bb4a-fe0e95c20fb7" status: 200 len: 1723 microversion: 2.20 time: 0.402984 Mar 05 02:54:10.539864 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 118/230] 10.222.0.26 () {60 vars in 1276 bytes} [Sat Mar 5 02:54:10 2022] GET /compute/v2.1/servers/e28e570d-3d50-4fe8-bb4a-fe0e95c20fb7 => generated 1723 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 02:54:10.546692 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-59bde9a7-dfb7-4824-9a49-6423bb31c8d5 tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:54:10.547497 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-59bde9a7-dfb7-4824-9a49-6423bb31c8d5 tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] [instance: 1330ae1f-2dd0-436c-bbaa-c3c2d711fb83] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:54:10.554666 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-59bde9a7-dfb7-4824-9a49-6423bb31c8d5 tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:10.555113 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-59bde9a7-dfb7-4824-9a49-6423bb31c8d5 tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:10.555886 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-59bde9a7-dfb7-4824-9a49-6423bb31c8d5 tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:10.556312 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-59bde9a7-dfb7-4824-9a49-6423bb31c8d5 tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:10.573864 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.wsgi [None req-59bde9a7-dfb7-4824-9a49-6423bb31c8d5 tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] HTTP exception thrown: Instance 1330ae1f-2dd0-436c-bbaa-c3c2d711fb83 could not be found. Mar 05 02:54:10.574534 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-59bde9a7-dfb7-4824-9a49-6423bb31c8d5 tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] Returning 404 to user: Instance 1330ae1f-2dd0-436c-bbaa-c3c2d711fb83 could not be found. {{(pid=123545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 02:54:10.575367 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-59bde9a7-dfb7-4824-9a49-6423bb31c8d5 tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] 10.222.0.26 "GET /compute/v2.1/servers/1330ae1f-2dd0-436c-bbaa-c3c2d711fb83" status: 404 len: 111 microversion: 2.1 time: 0.034244 Mar 05 02:54:10.577153 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 119/231] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:54:10 2022] GET /compute/v2.1/servers/1330ae1f-2dd0-436c-bbaa-c3c2d711fb83 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 05 02:54:10.733171 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-db932292-c735-432e-9787-df3a24167456 tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-296796739", "imageRef": "adbc7df1-116e-4f9f-a28d-a6a3c084cceb", "flavorRef": "452", "networks": [{"uuid": "bc3bb688-2082-4285-b145-f24c2a8d5bc2"}]}} {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 02:54:10.815133 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.network.neutron [None req-db932292-c735-432e-9787-df3a24167456 tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] validate_networks() for [('bc3bb688-2082-4285-b145-f24c2a8d5bc2', None, None, None, None, None)] {{(pid=123545) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 05 02:54:11.712174 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.virt.hardware [None req-05742581-2b5d-4f81-9e8a-ce6d9f2a3f0f tempest-VolumesSnapshotTestJSON-729970751 tempest-VolumesSnapshotTestJSON-729970751-project] Flavor limits 0:0:0 {{(pid=123546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 05 02:54:11.712796 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.virt.hardware [None req-05742581-2b5d-4f81-9e8a-ce6d9f2a3f0f tempest-VolumesSnapshotTestJSON-729970751 tempest-VolumesSnapshotTestJSON-729970751-project] Image limits 0:0:0 {{(pid=123546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 05 02:54:11.713455 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.virt.hardware [None req-05742581-2b5d-4f81-9e8a-ce6d9f2a3f0f tempest-VolumesSnapshotTestJSON-729970751 tempest-VolumesSnapshotTestJSON-729970751-project] Flavor pref 0:0:0 {{(pid=123546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 05 02:54:11.714037 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.virt.hardware [None req-05742581-2b5d-4f81-9e8a-ce6d9f2a3f0f tempest-VolumesSnapshotTestJSON-729970751 tempest-VolumesSnapshotTestJSON-729970751-project] Image pref 0:0:0 {{(pid=123546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 05 02:54:11.714531 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.virt.hardware [None req-05742581-2b5d-4f81-9e8a-ce6d9f2a3f0f tempest-VolumesSnapshotTestJSON-729970751 tempest-VolumesSnapshotTestJSON-729970751-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 05 02:54:11.745803 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-05742581-2b5d-4f81-9e8a-ce6d9f2a3f0f tempest-VolumesSnapshotTestJSON-729970751 tempest-VolumesSnapshotTestJSON-729970751-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:11.752456 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-05742581-2b5d-4f81-9e8a-ce6d9f2a3f0f tempest-VolumesSnapshotTestJSON-729970751 tempest-VolumesSnapshotTestJSON-729970751-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:11.754843 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-05742581-2b5d-4f81-9e8a-ce6d9f2a3f0f tempest-VolumesSnapshotTestJSON-729970751 tempest-VolumesSnapshotTestJSON-729970751-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:11.755517 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-05742581-2b5d-4f81-9e8a-ce6d9f2a3f0f tempest-VolumesSnapshotTestJSON-729970751 tempest-VolumesSnapshotTestJSON-729970751-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:11.798251 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.quota [None req-05742581-2b5d-4f81-9e8a-ce6d9f2a3f0f tempest-VolumesSnapshotTestJSON-729970751 tempest-VolumesSnapshotTestJSON-729970751-project] Getting quotas for project 8efa5f5dbc9f460aa91f4f62eb57abee. Resources: {'ram', 'cores', 'instances'} {{(pid=123546) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 02:54:11.812209 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.quota [None req-05742581-2b5d-4f81-9e8a-ce6d9f2a3f0f tempest-VolumesSnapshotTestJSON-729970751 tempest-VolumesSnapshotTestJSON-729970751-project] Getting quotas for user f84de0440c1444309d9c9b6c706bae73 and project 8efa5f5dbc9f460aa91f4f62eb57abee. Resources: {'ram', 'cores', 'instances'} {{(pid=123546) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 02:54:11.848464 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-05742581-2b5d-4f81-9e8a-ce6d9f2a3f0f tempest-VolumesSnapshotTestJSON-729970751 tempest-VolumesSnapshotTestJSON-729970751-project] Going to run 1 instances... {{(pid=123546) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 05 02:54:11.851420 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-05742581-2b5d-4f81-9e8a-ce6d9f2a3f0f tempest-VolumesSnapshotTestJSON-729970751 tempest-VolumesSnapshotTestJSON-729970751-project] [instance: b89e62f7-7ccc-48a6-ad76-88f6e022fe95] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='adbc7df1-116e-4f9f-a28d-a6a3c084cceb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123546) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 05 02:54:11.959220 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.virt.hardware [None req-db932292-c735-432e-9787-df3a24167456 tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] Flavor limits 0:0:0 {{(pid=123545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 05 02:54:11.960386 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.virt.hardware [None req-db932292-c735-432e-9787-df3a24167456 tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] Image limits 0:0:0 {{(pid=123545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 05 02:54:11.961073 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.virt.hardware [None req-db932292-c735-432e-9787-df3a24167456 tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] Flavor pref 0:0:0 {{(pid=123545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 05 02:54:11.961331 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-05742581-2b5d-4f81-9e8a-ce6d9f2a3f0f tempest-VolumesSnapshotTestJSON-729970751 tempest-VolumesSnapshotTestJSON-729970751-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.568822 Mar 05 02:54:11.961829 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.virt.hardware [None req-db932292-c735-432e-9787-df3a24167456 tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] Image pref 0:0:0 {{(pid=123545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 05 02:54:11.962500 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.virt.hardware [None req-db932292-c735-432e-9787-df3a24167456 tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 05 02:54:11.962771 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 113/232] 10.222.0.26 () {60 vars in 1146 bytes} [Sat Mar 5 02:54:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 1572 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 05 02:54:11.977103 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-0d2e8ece-f86e-495b-bfc8-aac236534d6c tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:54:11.979862 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-0d2e8ece-f86e-495b-bfc8-aac236534d6c tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] [instance: c24fee69-5bf4-40f4-ba18-56aecd12dd96] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:54:11.998960 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-db932292-c735-432e-9787-df3a24167456 tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:12.000146 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-db932292-c735-432e-9787-df3a24167456 tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:12.003786 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-db932292-c735-432e-9787-df3a24167456 tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:12.004352 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-db932292-c735-432e-9787-df3a24167456 tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:12.007568 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-0d2e8ece-f86e-495b-bfc8-aac236534d6c tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:12.008673 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-0d2e8ece-f86e-495b-bfc8-aac236534d6c tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:12.026059 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-0d2e8ece-f86e-495b-bfc8-aac236534d6c tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:12.027679 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-0d2e8ece-f86e-495b-bfc8-aac236534d6c tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:12.049917 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.quota [None req-db932292-c735-432e-9787-df3a24167456 tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] Getting quotas for project 3afb5b14217e4a54ab03e6233f8aaa07. Resources: {'ram', 'cores', 'instances'} {{(pid=123545) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 02:54:12.055436 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.quota [None req-db932292-c735-432e-9787-df3a24167456 tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] Getting quotas for user 1700aa8052b94f878886b08f94f05831 and project 3afb5b14217e4a54ab03e6233f8aaa07. Resources: {'ram', 'cores', 'instances'} {{(pid=123545) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 02:54:12.077068 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-db932292-c735-432e-9787-df3a24167456 tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] Going to run 1 instances... {{(pid=123545) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 05 02:54:12.083267 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-db932292-c735-432e-9787-df3a24167456 tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] [instance: d73f2b8e-9af1-4395-9995-f34cd8187681] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='adbc7df1-116e-4f9f-a28d-a6a3c084cceb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123545) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 05 02:54:12.202849 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-db932292-c735-432e-9787-df3a24167456 tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.478964 Mar 05 02:54:12.210828 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 120/233] 10.222.0.26 () {60 vars in 1146 bytes} [Sat Mar 5 02:54:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 1489 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Mar 05 02:54:12.216775 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-7d7caab9-ae04-400e-8741-7f0550b2ac08 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:54:12.217597 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-7d7caab9-ae04-400e-8741-7f0550b2ac08 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] [instance: e28e570d-3d50-4fe8-bb4a-fe0e95c20fb7] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:54:12.227547 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-7d7caab9-ae04-400e-8741-7f0550b2ac08 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:12.228678 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-7d7caab9-ae04-400e-8741-7f0550b2ac08 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:12.230445 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-7d7caab9-ae04-400e-8741-7f0550b2ac08 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:12.232024 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-7d7caab9-ae04-400e-8741-7f0550b2ac08 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:12.651793 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-0d2e8ece-f86e-495b-bfc8-aac236534d6c tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90033e5e8e634b699bf050e36519f8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8112a5759c444c1f94be24ab61bf072f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:54:12.660724 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-0d2e8ece-f86e-495b-bfc8-aac236534d6c tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] 10.222.0.26 "GET /compute/v2.1/servers/c24fee69-5bf4-40f4-ba18-56aecd12dd96" status: 200 len: 1500 microversion: 2.1 time: 0.696218 Mar 05 02:54:12.681747 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 114/234] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:54:11 2022] GET /compute/v2.1/servers/c24fee69-5bf4-40f4-ba18-56aecd12dd96 => generated 1500 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 02:54:12.693818 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-1daabe73-9e70-47ce-a675-4e8e638e40bc tempest-VolumesSnapshotTestJSON-729970751 tempest-VolumesSnapshotTestJSON-729970751-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:54:12.696537 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-1daabe73-9e70-47ce-a675-4e8e638e40bc tempest-VolumesSnapshotTestJSON-729970751 tempest-VolumesSnapshotTestJSON-729970751-project] [instance: b89e62f7-7ccc-48a6-ad76-88f6e022fe95] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:54:12.836321 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-7d7caab9-ae04-400e-8741-7f0550b2ac08 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:54:12.852902 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-7d7caab9-ae04-400e-8741-7f0550b2ac08 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:54:12.859198 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-7d7caab9-ae04-400e-8741-7f0550b2ac08 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:54:12.863749 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-7d7caab9-ae04-400e-8741-7f0550b2ac08 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] 10.222.0.26 "GET /compute/v2.1/servers/e28e570d-3d50-4fe8-bb4a-fe0e95c20fb7" status: 200 len: 1723 microversion: 2.20 time: 0.651602 Mar 05 02:54:12.869599 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 121/235] 10.222.0.26 () {60 vars in 1276 bytes} [Sat Mar 5 02:54:12 2022] GET /compute/v2.1/servers/e28e570d-3d50-4fe8-bb4a-fe0e95c20fb7 => generated 1723 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 02:54:12.907429 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-a392ad24-073d-4f97-83bf-66100e06f17a tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:54:12.908296 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-a392ad24-073d-4f97-83bf-66100e06f17a tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] [instance: d73f2b8e-9af1-4395-9995-f34cd8187681] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:54:13.043252 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-1daabe73-9e70-47ce-a675-4e8e638e40bc tempest-VolumesSnapshotTestJSON-729970751 tempest-VolumesSnapshotTestJSON-729970751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84de0440c1444309d9c9b6c706bae73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8efa5f5dbc9f460aa91f4f62eb57abee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:54:13.051368 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-1daabe73-9e70-47ce-a675-4e8e638e40bc tempest-VolumesSnapshotTestJSON-729970751 tempest-VolumesSnapshotTestJSON-729970751-project] 10.222.0.26 "GET /compute/v2.1/servers/b89e62f7-7ccc-48a6-ad76-88f6e022fe95" status: 200 len: 1218 microversion: 2.1 time: 0.364500 Mar 05 02:54:13.057968 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 115/236] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:54:12 2022] GET /compute/v2.1/servers/b89e62f7-7ccc-48a6-ad76-88f6e022fe95 => generated 1218 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 02:54:13.066682 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-590b6256-7aa9-408f-a66c-55d771a24a69 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 02:54:13.081856 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-590b6256-7aa9-408f-a66c-55d771a24a69 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:13.082412 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-590b6256-7aa9-408f-a66c-55d771a24a69 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:13.122433 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-a392ad24-073d-4f97-83bf-66100e06f17a tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1700aa8052b94f878886b08f94f05831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3afb5b14217e4a54ab03e6233f8aaa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:54:13.132902 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-a392ad24-073d-4f97-83bf-66100e06f17a tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] 10.222.0.26 "GET /compute/v2.1/servers/d73f2b8e-9af1-4395-9995-f34cd8187681" status: 200 len: 1213 microversion: 2.1 time: 0.261477 Mar 05 02:54:13.135948 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 122/237] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:54:12 2022] GET /compute/v2.1/servers/d73f2b8e-9af1-4395-9995-f34cd8187681 => generated 1213 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 02:54:13.153423 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-5dd5cbd2-3069-4014-945a-664cc24bb590 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4e0a0e3a-f08e-4f2a-a9f4-a0b00cb28290"}} {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 02:54:13.156906 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-5dd5cbd2-3069-4014-945a-664cc24bb590 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] [instance: c24fee69-5bf4-40f4-ba18-56aecd12dd96] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:54:13.171483 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-5dd5cbd2-3069-4014-945a-664cc24bb590 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:13.178457 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-5dd5cbd2-3069-4014-945a-664cc24bb590 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:13.179671 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-5dd5cbd2-3069-4014-945a-664cc24bb590 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:13.180318 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-5dd5cbd2-3069-4014-945a-664cc24bb590 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:13.214395 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-590b6256-7aa9-408f-a66c-55d771a24a69 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] [instance: d0080e4b-6532-4e0c-8d19-cfbdf32e401b] Going to try to stop instance {{(pid=123546) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Mar 05 02:54:13.227071 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.wsgi [None req-5dd5cbd2-3069-4014-945a-664cc24bb590 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] HTTP exception thrown: Cannot 'attach_volume' instance c24fee69-5bf4-40f4-ba18-56aecd12dd96 while it is in vm_state rescued Mar 05 02:54:13.232287 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-5dd5cbd2-3069-4014-945a-664cc24bb590 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Returning 409 to user: Cannot 'attach_volume' instance c24fee69-5bf4-40f4-ba18-56aecd12dd96 while it is in vm_state rescued {{(pid=123545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 02:54:13.233332 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-5dd5cbd2-3069-4014-945a-664cc24bb590 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] 10.222.0.26 "POST /compute/v2.1/servers/c24fee69-5bf4-40f4-ba18-56aecd12dd96/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.096221 Mar 05 02:54:13.235898 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 123/238] 10.222.0.26 () {60 vars in 1322 bytes} [Sat Mar 5 02:54:13 2022] POST /compute/v2.1/servers/c24fee69-5bf4-40f4-ba18-56aecd12dd96/os-volume_attachments => generated 152 bytes in 99 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Mar 05 02:54:13.250478 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-5b884dfc-14ed-44ff-9a51-9e1bc3568714 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 02:54:13.251497 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-5b884dfc-14ed-44ff-9a51-9e1bc3568714 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] [instance: c24fee69-5bf4-40f4-ba18-56aecd12dd96] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:54:13.263534 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-5b884dfc-14ed-44ff-9a51-9e1bc3568714 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:13.267137 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-5b884dfc-14ed-44ff-9a51-9e1bc3568714 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:13.268194 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-5b884dfc-14ed-44ff-9a51-9e1bc3568714 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:13.270004 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-5b884dfc-14ed-44ff-9a51-9e1bc3568714 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:13.285109 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-590b6256-7aa9-408f-a66c-55d771a24a69 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] 10.222.0.26 "POST /compute/v2.1/servers/d0080e4b-6532-4e0c-8d19-cfbdf32e401b/action" status: 202 len: 0 microversion: 2.1 time: 0.225546 Mar 05 02:54:13.285909 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 116/239] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Mar 5 02:54:13 2022] POST /compute/v2.1/servers/d0080e4b-6532-4e0c-8d19-cfbdf32e401b/action => generated 0 bytes in 227 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 05 02:54:13.301717 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-ee2f5273-ec71-4da1-81a6-c189e56ffd1c tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:54:13.307133 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-ee2f5273-ec71-4da1-81a6-c189e56ffd1c tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] [instance: d0080e4b-6532-4e0c-8d19-cfbdf32e401b] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:54:13.332386 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-ee2f5273-ec71-4da1-81a6-c189e56ffd1c tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:13.332857 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-ee2f5273-ec71-4da1-81a6-c189e56ffd1c tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:13.333657 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-ee2f5273-ec71-4da1-81a6-c189e56ffd1c tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:13.334194 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-ee2f5273-ec71-4da1-81a6-c189e56ffd1c tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:13.406880 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-5b884dfc-14ed-44ff-9a51-9e1bc3568714 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] 10.222.0.26 "POST /compute/v2.1/servers/c24fee69-5bf4-40f4-ba18-56aecd12dd96/action" status: 202 len: 0 microversion: 2.1 time: 0.165833 Mar 05 02:54:13.408182 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 124/240] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Mar 5 02:54:13 2022] POST /compute/v2.1/servers/c24fee69-5bf4-40f4-ba18-56aecd12dd96/action => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Mar 05 02:54:13.416549 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-671c463e-f71c-487d-b35e-6ac02b02bd78 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:54:13.427067 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-671c463e-f71c-487d-b35e-6ac02b02bd78 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] [instance: c24fee69-5bf4-40f4-ba18-56aecd12dd96] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:54:13.437455 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-671c463e-f71c-487d-b35e-6ac02b02bd78 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:13.441647 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-671c463e-f71c-487d-b35e-6ac02b02bd78 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:13.447075 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-671c463e-f71c-487d-b35e-6ac02b02bd78 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:13.448638 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-671c463e-f71c-487d-b35e-6ac02b02bd78 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:13.851714 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-ee2f5273-ec71-4da1-81a6-c189e56ffd1c tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e5a000087fe40419ccd0d1a96fb4783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9d27da2e71d4962a53a95efc46518ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:54:13.855504 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-671c463e-f71c-487d-b35e-6ac02b02bd78 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90033e5e8e634b699bf050e36519f8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8112a5759c444c1f94be24ab61bf072f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:54:13.866460 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-ee2f5273-ec71-4da1-81a6-c189e56ffd1c tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] 10.222.0.26 "GET /compute/v2.1/servers/d0080e4b-6532-4e0c-8d19-cfbdf32e401b" status: 200 len: 1724 microversion: 2.1 time: 0.569633 Mar 05 02:54:13.866815 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-671c463e-f71c-487d-b35e-6ac02b02bd78 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] 10.222.0.26 "GET /compute/v2.1/servers/c24fee69-5bf4-40f4-ba18-56aecd12dd96" status: 200 len: 1508 microversion: 2.1 time: 0.454381 Mar 05 02:54:13.868258 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 117/241] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:54:13 2022] GET /compute/v2.1/servers/d0080e4b-6532-4e0c-8d19-cfbdf32e401b => generated 1724 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 02:54:13.869717 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 125/242] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:54:13 2022] GET /compute/v2.1/servers/c24fee69-5bf4-40f4-ba18-56aecd12dd96 => generated 1508 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 02:54:13.886259 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-67c944d0-4a7e-4916-87ba-4d444be55075 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:54:13.887280 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-67c944d0-4a7e-4916-87ba-4d444be55075 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] [instance: e28e570d-3d50-4fe8-bb4a-fe0e95c20fb7] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:54:13.902818 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-67c944d0-4a7e-4916-87ba-4d444be55075 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:13.903917 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-67c944d0-4a7e-4916-87ba-4d444be55075 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:13.905124 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-67c944d0-4a7e-4916-87ba-4d444be55075 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:13.905778 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-67c944d0-4a7e-4916-87ba-4d444be55075 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:14.070132 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-d5481a9b-abb5-4437-baaf-8a3833385c59 tempest-VolumesSnapshotTestJSON-729970751 tempest-VolumesSnapshotTestJSON-729970751-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:54:14.070807 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-d5481a9b-abb5-4437-baaf-8a3833385c59 tempest-VolumesSnapshotTestJSON-729970751 tempest-VolumesSnapshotTestJSON-729970751-project] [instance: b89e62f7-7ccc-48a6-ad76-88f6e022fe95] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:54:14.086717 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-d5481a9b-abb5-4437-baaf-8a3833385c59 tempest-VolumesSnapshotTestJSON-729970751 tempest-VolumesSnapshotTestJSON-729970751-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:14.088869 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-d5481a9b-abb5-4437-baaf-8a3833385c59 tempest-VolumesSnapshotTestJSON-729970751 tempest-VolumesSnapshotTestJSON-729970751-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:14.089993 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-d5481a9b-abb5-4437-baaf-8a3833385c59 tempest-VolumesSnapshotTestJSON-729970751 tempest-VolumesSnapshotTestJSON-729970751-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:14.093149 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-d5481a9b-abb5-4437-baaf-8a3833385c59 tempest-VolumesSnapshotTestJSON-729970751 tempest-VolumesSnapshotTestJSON-729970751-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:14.242730 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-d5481a9b-abb5-4437-baaf-8a3833385c59 tempest-VolumesSnapshotTestJSON-729970751 tempest-VolumesSnapshotTestJSON-729970751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84de0440c1444309d9c9b6c706bae73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8efa5f5dbc9f460aa91f4f62eb57abee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:54:14.254786 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-d5481a9b-abb5-4437-baaf-8a3833385c59 tempest-VolumesSnapshotTestJSON-729970751 tempest-VolumesSnapshotTestJSON-729970751-project] 10.222.0.26 "GET /compute/v2.1/servers/b89e62f7-7ccc-48a6-ad76-88f6e022fe95" status: 200 len: 1278 microversion: 2.1 time: 0.189176 Mar 05 02:54:14.256278 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 126/243] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:54:14 2022] GET /compute/v2.1/servers/b89e62f7-7ccc-48a6-ad76-88f6e022fe95 => generated 1278 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 02:54:14.263140 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-484484f3-8e14-4637-b9d5-b5412da5ff2c tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:54:14.264828 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-484484f3-8e14-4637-b9d5-b5412da5ff2c tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] [instance: d73f2b8e-9af1-4395-9995-f34cd8187681] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:54:14.274990 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-484484f3-8e14-4637-b9d5-b5412da5ff2c tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:14.275502 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-484484f3-8e14-4637-b9d5-b5412da5ff2c tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:14.278304 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-484484f3-8e14-4637-b9d5-b5412da5ff2c tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:14.280813 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-484484f3-8e14-4637-b9d5-b5412da5ff2c tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:14.730367 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-484484f3-8e14-4637-b9d5-b5412da5ff2c tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1700aa8052b94f878886b08f94f05831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3afb5b14217e4a54ab03e6233f8aaa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:54:14.753565 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-484484f3-8e14-4637-b9d5-b5412da5ff2c tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] 10.222.0.26 "GET /compute/v2.1/servers/d73f2b8e-9af1-4395-9995-f34cd8187681" status: 200 len: 1283 microversion: 2.1 time: 0.495748 Mar 05 02:54:14.760637 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 127/244] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:54:14 2022] GET /compute/v2.1/servers/d73f2b8e-9af1-4395-9995-f34cd8187681 => generated 1283 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 02:54:14.798727 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-67c944d0-4a7e-4916-87ba-4d444be55075 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:54:14.818630 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-67c944d0-4a7e-4916-87ba-4d444be55075 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:54:14.820205 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-67c944d0-4a7e-4916-87ba-4d444be55075 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:54:14.827805 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-67c944d0-4a7e-4916-87ba-4d444be55075 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] 10.222.0.26 "GET /compute/v2.1/servers/e28e570d-3d50-4fe8-bb4a-fe0e95c20fb7" status: 200 len: 1723 microversion: 2.20 time: 0.945478 Mar 05 02:54:14.830647 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 118/245] 10.222.0.26 () {60 vars in 1276 bytes} [Sat Mar 5 02:54:13 2022] GET /compute/v2.1/servers/e28e570d-3d50-4fe8-bb4a-fe0e95c20fb7 => generated 1723 bytes in 949 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 02:54:14.884912 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-7691cce1-f9e2-437d-ba0c-9d656794d9ea tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:54:14.885158 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-7e90e1b6-b4a3-43b8-8bc5-eea21cc5bdc6 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:54:14.885722 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-7691cce1-f9e2-437d-ba0c-9d656794d9ea tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] [instance: d0080e4b-6532-4e0c-8d19-cfbdf32e401b] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:54:14.886175 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-7e90e1b6-b4a3-43b8-8bc5-eea21cc5bdc6 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] [instance: c24fee69-5bf4-40f4-ba18-56aecd12dd96] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:54:14.895361 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-7691cce1-f9e2-437d-ba0c-9d656794d9ea tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:14.895837 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-7691cce1-f9e2-437d-ba0c-9d656794d9ea tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:14.896642 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-7691cce1-f9e2-437d-ba0c-9d656794d9ea tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:14.896864 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-7e90e1b6-b4a3-43b8-8bc5-eea21cc5bdc6 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:14.897090 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-7691cce1-f9e2-437d-ba0c-9d656794d9ea tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:14.897692 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-7e90e1b6-b4a3-43b8-8bc5-eea21cc5bdc6 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:14.902847 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-7e90e1b6-b4a3-43b8-8bc5-eea21cc5bdc6 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:14.903499 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-7e90e1b6-b4a3-43b8-8bc5-eea21cc5bdc6 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:15.547651 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-7e90e1b6-b4a3-43b8-8bc5-eea21cc5bdc6 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90033e5e8e634b699bf050e36519f8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8112a5759c444c1f94be24ab61bf072f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:54:15.558823 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-7e90e1b6-b4a3-43b8-8bc5-eea21cc5bdc6 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] 10.222.0.26 "GET /compute/v2.1/servers/c24fee69-5bf4-40f4-ba18-56aecd12dd96" status: 200 len: 1508 microversion: 2.1 time: 0.677382 Mar 05 02:54:15.560387 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 119/246] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:54:14 2022] GET /compute/v2.1/servers/c24fee69-5bf4-40f4-ba18-56aecd12dd96 => generated 1508 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 02:54:15.568050 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-917f7aee-e548-41e8-bc55-1f1957b937ed tempest-VolumesSnapshotTestJSON-729970751 tempest-VolumesSnapshotTestJSON-729970751-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:54:15.569686 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-917f7aee-e548-41e8-bc55-1f1957b937ed tempest-VolumesSnapshotTestJSON-729970751 tempest-VolumesSnapshotTestJSON-729970751-project] [instance: b89e62f7-7ccc-48a6-ad76-88f6e022fe95] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:54:15.579469 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-917f7aee-e548-41e8-bc55-1f1957b937ed tempest-VolumesSnapshotTestJSON-729970751 tempest-VolumesSnapshotTestJSON-729970751-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:15.580207 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-917f7aee-e548-41e8-bc55-1f1957b937ed tempest-VolumesSnapshotTestJSON-729970751 tempest-VolumesSnapshotTestJSON-729970751-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:15.582419 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-917f7aee-e548-41e8-bc55-1f1957b937ed tempest-VolumesSnapshotTestJSON-729970751 tempest-VolumesSnapshotTestJSON-729970751-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:15.583168 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-917f7aee-e548-41e8-bc55-1f1957b937ed tempest-VolumesSnapshotTestJSON-729970751 tempest-VolumesSnapshotTestJSON-729970751-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:15.615813 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-7691cce1-f9e2-437d-ba0c-9d656794d9ea tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e5a000087fe40419ccd0d1a96fb4783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9d27da2e71d4962a53a95efc46518ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:54:15.624562 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-7691cce1-f9e2-437d-ba0c-9d656794d9ea tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] 10.222.0.26 "GET /compute/v2.1/servers/d0080e4b-6532-4e0c-8d19-cfbdf32e401b" status: 200 len: 1724 microversion: 2.1 time: 0.743641 Mar 05 02:54:15.639009 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 128/247] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:54:14 2022] GET /compute/v2.1/servers/d0080e4b-6532-4e0c-8d19-cfbdf32e401b => generated 1724 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 02:54:15.782107 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-603315c6-8e46-41ff-8218-dcfded88746e tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:54:15.783717 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-603315c6-8e46-41ff-8218-dcfded88746e tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] [instance: d73f2b8e-9af1-4395-9995-f34cd8187681] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:54:15.790682 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-603315c6-8e46-41ff-8218-dcfded88746e tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:15.791236 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-603315c6-8e46-41ff-8218-dcfded88746e tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:15.791358 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-917f7aee-e548-41e8-bc55-1f1957b937ed tempest-VolumesSnapshotTestJSON-729970751 tempest-VolumesSnapshotTestJSON-729970751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84de0440c1444309d9c9b6c706bae73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8efa5f5dbc9f460aa91f4f62eb57abee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:54:15.792206 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-603315c6-8e46-41ff-8218-dcfded88746e tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:15.792890 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-603315c6-8e46-41ff-8218-dcfded88746e tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:15.803623 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-917f7aee-e548-41e8-bc55-1f1957b937ed tempest-VolumesSnapshotTestJSON-729970751 tempest-VolumesSnapshotTestJSON-729970751-project] 10.222.0.26 "GET /compute/v2.1/servers/b89e62f7-7ccc-48a6-ad76-88f6e022fe95" status: 200 len: 1276 microversion: 2.1 time: 0.241708 Mar 05 02:54:15.805976 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 120/248] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:54:15 2022] GET /compute/v2.1/servers/b89e62f7-7ccc-48a6-ad76-88f6e022fe95 => generated 1276 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 02:54:15.849985 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-5dd069ba-615a-4c65-af74-cf781619ce7c tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:54:15.851025 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-5dd069ba-615a-4c65-af74-cf781619ce7c tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] [instance: e28e570d-3d50-4fe8-bb4a-fe0e95c20fb7] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:54:15.859221 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-5dd069ba-615a-4c65-af74-cf781619ce7c tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:15.862620 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-5dd069ba-615a-4c65-af74-cf781619ce7c tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:15.863811 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-5dd069ba-615a-4c65-af74-cf781619ce7c tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:15.864543 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-5dd069ba-615a-4c65-af74-cf781619ce7c tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:15.985014 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-603315c6-8e46-41ff-8218-dcfded88746e tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1700aa8052b94f878886b08f94f05831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3afb5b14217e4a54ab03e6233f8aaa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:54:16.000457 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-603315c6-8e46-41ff-8218-dcfded88746e tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] 10.222.0.26 "GET /compute/v2.1/servers/d73f2b8e-9af1-4395-9995-f34cd8187681" status: 200 len: 1271 microversion: 2.1 time: 0.223120 Mar 05 02:54:16.001717 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 129/249] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:54:15 2022] GET /compute/v2.1/servers/d73f2b8e-9af1-4395-9995-f34cd8187681 => generated 1271 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 02:54:16.434762 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-5dd069ba-615a-4c65-af74-cf781619ce7c tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:54:16.446775 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-5dd069ba-615a-4c65-af74-cf781619ce7c tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:54:16.448282 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-5dd069ba-615a-4c65-af74-cf781619ce7c tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:54:16.449483 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-5dd069ba-615a-4c65-af74-cf781619ce7c tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] 10.222.0.26 "GET /compute/v2.1/servers/e28e570d-3d50-4fe8-bb4a-fe0e95c20fb7" status: 200 len: 1744 microversion: 2.20 time: 0.604479 Mar 05 02:54:16.454013 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 121/250] 10.222.0.26 () {60 vars in 1276 bytes} [Sat Mar 5 02:54:15 2022] GET /compute/v2.1/servers/e28e570d-3d50-4fe8-bb4a-fe0e95c20fb7 => generated 1744 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 05 02:54:16.584948 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-783f9b32-14c3-41dc-bfd9-8d3a896d07f5 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:54:16.585838 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-783f9b32-14c3-41dc-bfd9-8d3a896d07f5 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] [instance: c24fee69-5bf4-40f4-ba18-56aecd12dd96] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:54:16.613825 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-783f9b32-14c3-41dc-bfd9-8d3a896d07f5 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:16.614545 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-783f9b32-14c3-41dc-bfd9-8d3a896d07f5 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:16.615664 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-783f9b32-14c3-41dc-bfd9-8d3a896d07f5 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:16.616119 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-783f9b32-14c3-41dc-bfd9-8d3a896d07f5 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:16.667350 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-f8f0f07d-7f3d-4e71-9bc4-7d68fd524606 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:54:16.667988 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-f8f0f07d-7f3d-4e71-9bc4-7d68fd524606 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] [instance: d0080e4b-6532-4e0c-8d19-cfbdf32e401b] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:54:16.675968 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-f8f0f07d-7f3d-4e71-9bc4-7d68fd524606 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:16.676844 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-f8f0f07d-7f3d-4e71-9bc4-7d68fd524606 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:16.678734 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-f8f0f07d-7f3d-4e71-9bc4-7d68fd524606 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:16.679534 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-f8f0f07d-7f3d-4e71-9bc4-7d68fd524606 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:17.460408 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-783f9b32-14c3-41dc-bfd9-8d3a896d07f5 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90033e5e8e634b699bf050e36519f8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8112a5759c444c1f94be24ab61bf072f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:54:17.473321 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-783f9b32-14c3-41dc-bfd9-8d3a896d07f5 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] 10.222.0.26 "GET /compute/v2.1/servers/c24fee69-5bf4-40f4-ba18-56aecd12dd96" status: 200 len: 1514 microversion: 2.1 time: 0.894257 Mar 05 02:54:17.473934 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 130/251] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:54:16 2022] GET /compute/v2.1/servers/c24fee69-5bf4-40f4-ba18-56aecd12dd96 => generated 1514 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 02:54:17.479090 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-e2e92630-a94d-4d5b-a455-a81554eeea88 tempest-VolumesSnapshotTestJSON-729970751 tempest-VolumesSnapshotTestJSON-729970751-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:54:17.479950 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-e2e92630-a94d-4d5b-a455-a81554eeea88 tempest-VolumesSnapshotTestJSON-729970751 tempest-VolumesSnapshotTestJSON-729970751-project] [instance: b89e62f7-7ccc-48a6-ad76-88f6e022fe95] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:54:17.494160 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-e2e92630-a94d-4d5b-a455-a81554eeea88 tempest-VolumesSnapshotTestJSON-729970751 tempest-VolumesSnapshotTestJSON-729970751-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:17.494160 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-e2e92630-a94d-4d5b-a455-a81554eeea88 tempest-VolumesSnapshotTestJSON-729970751 tempest-VolumesSnapshotTestJSON-729970751-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:17.494160 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-e2e92630-a94d-4d5b-a455-a81554eeea88 tempest-VolumesSnapshotTestJSON-729970751 tempest-VolumesSnapshotTestJSON-729970751-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:17.494160 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-e2e92630-a94d-4d5b-a455-a81554eeea88 tempest-VolumesSnapshotTestJSON-729970751 tempest-VolumesSnapshotTestJSON-729970751-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:17.513224 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-f8f0f07d-7f3d-4e71-9bc4-7d68fd524606 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e5a000087fe40419ccd0d1a96fb4783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9d27da2e71d4962a53a95efc46518ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:54:17.523927 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-f8f0f07d-7f3d-4e71-9bc4-7d68fd524606 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] 10.222.0.26 "GET /compute/v2.1/servers/d0080e4b-6532-4e0c-8d19-cfbdf32e401b" status: 200 len: 1724 microversion: 2.1 time: 0.872501 Mar 05 02:54:17.524879 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 122/252] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:54:16 2022] GET /compute/v2.1/servers/d0080e4b-6532-4e0c-8d19-cfbdf32e401b => generated 1724 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 02:54:17.530829 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-0586abd8-da32-4855-af93-c6857346f6aa tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:54:17.531836 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-0586abd8-da32-4855-af93-c6857346f6aa tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] [instance: d73f2b8e-9af1-4395-9995-f34cd8187681] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:54:17.538836 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-0586abd8-da32-4855-af93-c6857346f6aa tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:17.539538 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-0586abd8-da32-4855-af93-c6857346f6aa tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:17.540898 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-0586abd8-da32-4855-af93-c6857346f6aa tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:17.541653 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-0586abd8-da32-4855-af93-c6857346f6aa tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:18.130593 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-e2e92630-a94d-4d5b-a455-a81554eeea88 tempest-VolumesSnapshotTestJSON-729970751 tempest-VolumesSnapshotTestJSON-729970751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84de0440c1444309d9c9b6c706bae73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8efa5f5dbc9f460aa91f4f62eb57abee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:54:18.140656 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-e2e92630-a94d-4d5b-a455-a81554eeea88 tempest-VolumesSnapshotTestJSON-729970751 tempest-VolumesSnapshotTestJSON-729970751-project] 10.222.0.26 "GET /compute/v2.1/servers/b89e62f7-7ccc-48a6-ad76-88f6e022fe95" status: 200 len: 1318 microversion: 2.1 time: 0.665152 Mar 05 02:54:18.141509 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 131/253] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:54:17 2022] GET /compute/v2.1/servers/b89e62f7-7ccc-48a6-ad76-88f6e022fe95 => generated 1318 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 02:54:18.150689 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-223e2b32-8ea1-43a3-a3be-64842ef2b433 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:54:18.150689 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-223e2b32-8ea1-43a3-a3be-64842ef2b433 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] [instance: e28e570d-3d50-4fe8-bb4a-fe0e95c20fb7] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:54:18.156358 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-223e2b32-8ea1-43a3-a3be-64842ef2b433 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:18.156818 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-223e2b32-8ea1-43a3-a3be-64842ef2b433 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:18.158398 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-223e2b32-8ea1-43a3-a3be-64842ef2b433 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:18.158840 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-223e2b32-8ea1-43a3-a3be-64842ef2b433 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:18.164690 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-0586abd8-da32-4855-af93-c6857346f6aa tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1700aa8052b94f878886b08f94f05831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3afb5b14217e4a54ab03e6233f8aaa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:54:18.175090 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-0586abd8-da32-4855-af93-c6857346f6aa tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] 10.222.0.26 "GET /compute/v2.1/servers/d73f2b8e-9af1-4395-9995-f34cd8187681" status: 200 len: 1313 microversion: 2.1 time: 0.647400 Mar 05 02:54:18.176278 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 123/254] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:54:17 2022] GET /compute/v2.1/servers/d73f2b8e-9af1-4395-9995-f34cd8187681 => generated 1313 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 02:54:18.188946 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-e61dc74a-27c6-4ea6-9133-0e791c538140 tempest-VolumesNegativeTest-1423831724 tempest-VolumesNegativeTest-1423831724-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-630503204", "imageRef": "adbc7df1-116e-4f9f-a28d-a6a3c084cceb", "flavorRef": "452"}} {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 02:54:18.265641 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.network.neutron [None req-e61dc74a-27c6-4ea6-9133-0e791c538140 tempest-VolumesNegativeTest-1423831724 tempest-VolumesNegativeTest-1423831724-project] validate_networks() for None {{(pid=123546) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 05 02:54:18.878424 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-223e2b32-8ea1-43a3-a3be-64842ef2b433 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:54:18.887116 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-223e2b32-8ea1-43a3-a3be-64842ef2b433 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:54:18.891645 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-223e2b32-8ea1-43a3-a3be-64842ef2b433 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:54:18.898133 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-223e2b32-8ea1-43a3-a3be-64842ef2b433 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] 10.222.0.26 "GET /compute/v2.1/servers/e28e570d-3d50-4fe8-bb4a-fe0e95c20fb7" status: 200 len: 1739 microversion: 2.20 time: 0.750338 Mar 05 02:54:18.898947 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 132/255] 10.222.0.26 () {60 vars in 1276 bytes} [Sat Mar 5 02:54:18 2022] GET /compute/v2.1/servers/e28e570d-3d50-4fe8-bb4a-fe0e95c20fb7 => generated 1739 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 02:54:18.903933 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-4724a239-ab60-410c-9447-c4f1841a2fcf tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:54:18.909885 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-4724a239-ab60-410c-9447-c4f1841a2fcf tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] [instance: d0080e4b-6532-4e0c-8d19-cfbdf32e401b] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:54:18.923497 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-4724a239-ab60-410c-9447-c4f1841a2fcf tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:18.924495 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-4724a239-ab60-410c-9447-c4f1841a2fcf tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:18.926461 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-4724a239-ab60-410c-9447-c4f1841a2fcf tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:18.926903 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-4724a239-ab60-410c-9447-c4f1841a2fcf tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:19.262095 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.virt.hardware [None req-e61dc74a-27c6-4ea6-9133-0e791c538140 tempest-VolumesNegativeTest-1423831724 tempest-VolumesNegativeTest-1423831724-project] Flavor limits 0:0:0 {{(pid=123546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 05 02:54:19.263777 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.virt.hardware [None req-e61dc74a-27c6-4ea6-9133-0e791c538140 tempest-VolumesNegativeTest-1423831724 tempest-VolumesNegativeTest-1423831724-project] Image limits 0:0:0 {{(pid=123546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 05 02:54:19.264545 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.virt.hardware [None req-e61dc74a-27c6-4ea6-9133-0e791c538140 tempest-VolumesNegativeTest-1423831724 tempest-VolumesNegativeTest-1423831724-project] Flavor pref 0:0:0 {{(pid=123546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 05 02:54:19.265929 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.virt.hardware [None req-e61dc74a-27c6-4ea6-9133-0e791c538140 tempest-VolumesNegativeTest-1423831724 tempest-VolumesNegativeTest-1423831724-project] Image pref 0:0:0 {{(pid=123546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 05 02:54:19.266566 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.virt.hardware [None req-e61dc74a-27c6-4ea6-9133-0e791c538140 tempest-VolumesNegativeTest-1423831724 tempest-VolumesNegativeTest-1423831724-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 05 02:54:19.282824 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-e61dc74a-27c6-4ea6-9133-0e791c538140 tempest-VolumesNegativeTest-1423831724 tempest-VolumesNegativeTest-1423831724-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:19.283686 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-e61dc74a-27c6-4ea6-9133-0e791c538140 tempest-VolumesNegativeTest-1423831724 tempest-VolumesNegativeTest-1423831724-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:19.284603 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-e61dc74a-27c6-4ea6-9133-0e791c538140 tempest-VolumesNegativeTest-1423831724 tempest-VolumesNegativeTest-1423831724-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:19.285119 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-e61dc74a-27c6-4ea6-9133-0e791c538140 tempest-VolumesNegativeTest-1423831724 tempest-VolumesNegativeTest-1423831724-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:19.308312 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.quota [None req-e61dc74a-27c6-4ea6-9133-0e791c538140 tempest-VolumesNegativeTest-1423831724 tempest-VolumesNegativeTest-1423831724-project] Getting quotas for project e6d0875d975e453cab8434d214003ffe. Resources: {'ram', 'cores', 'instances'} {{(pid=123546) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 02:54:19.316426 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.quota [None req-e61dc74a-27c6-4ea6-9133-0e791c538140 tempest-VolumesNegativeTest-1423831724 tempest-VolumesNegativeTest-1423831724-project] Getting quotas for user 2097ae8dee5b4d17a4f4921393c3e70f and project e6d0875d975e453cab8434d214003ffe. Resources: {'ram', 'cores', 'instances'} {{(pid=123546) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 02:54:19.330899 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-e61dc74a-27c6-4ea6-9133-0e791c538140 tempest-VolumesNegativeTest-1423831724 tempest-VolumesNegativeTest-1423831724-project] Going to run 1 instances... {{(pid=123546) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 05 02:54:19.333228 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-e61dc74a-27c6-4ea6-9133-0e791c538140 tempest-VolumesNegativeTest-1423831724 tempest-VolumesNegativeTest-1423831724-project] [instance: a8a27b43-73c6-4d5a-87ee-888eda8d677b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='adbc7df1-116e-4f9f-a28d-a6a3c084cceb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123546) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 05 02:54:19.406880 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-e61dc74a-27c6-4ea6-9133-0e791c538140 tempest-VolumesNegativeTest-1423831724 tempest-VolumesNegativeTest-1423831724-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.229903 Mar 05 02:54:19.408099 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 124/256] 10.222.0.26 () {60 vars in 1146 bytes} [Sat Mar 5 02:54:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 1232 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 05 02:54:19.421480 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [req-e6af8382-ea33-45e5-a7b9-e502229c31d9 req-a65ae6e8-322c-4d99-8500-76d8c273b903 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e28e570d-3d50-4fe8-bb4a-fe0e95c20fb7", "name": "network-vif-plugged", "status": "completed", "tag": "f280dd1a-3e15-49a1-9569-b6b40278e2a2"}]} {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 02:54:19.439186 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [req-e6af8382-ea33-45e5-a7b9-e502229c31d9 req-a65ae6e8-322c-4d99-8500-76d8c273b903 service nova] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:19.440308 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [req-e6af8382-ea33-45e5-a7b9-e502229c31d9 req-a65ae6e8-322c-4d99-8500-76d8c273b903 service nova] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:19.457652 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.compute.server_external_events [req-e6af8382-ea33-45e5-a7b9-e502229c31d9 req-a65ae6e8-322c-4d99-8500-76d8c273b903 service nova] Creating event network-vif-plugged:f280dd1a-3e15-49a1-9569-b6b40278e2a2 for instance e28e570d-3d50-4fe8-bb4a-fe0e95c20fb7 on hv-cinder-82725 Mar 05 02:54:19.467379 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [req-e6af8382-ea33-45e5-a7b9-e502229c31d9 req-a65ae6e8-322c-4d99-8500-76d8c273b903 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056148 Mar 05 02:54:19.468744 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 125/257] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Mar 5 02:54:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 02:54:19.475166 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-d60d42fe-0875-4bee-87d6-ee19de3cb4a4 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:54:19.476177 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-d60d42fe-0875-4bee-87d6-ee19de3cb4a4 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] [instance: c24fee69-5bf4-40f4-ba18-56aecd12dd96] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:54:19.485357 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-d60d42fe-0875-4bee-87d6-ee19de3cb4a4 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:19.486115 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-d60d42fe-0875-4bee-87d6-ee19de3cb4a4 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:19.487085 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-d60d42fe-0875-4bee-87d6-ee19de3cb4a4 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:19.487674 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-d60d42fe-0875-4bee-87d6-ee19de3cb4a4 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:19.799685 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-4724a239-ab60-410c-9447-c4f1841a2fcf tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e5a000087fe40419ccd0d1a96fb4783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9d27da2e71d4962a53a95efc46518ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:54:19.807576 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-4724a239-ab60-410c-9447-c4f1841a2fcf tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] 10.222.0.26 "GET /compute/v2.1/servers/d0080e4b-6532-4e0c-8d19-cfbdf32e401b" status: 200 len: 1724 microversion: 2.1 time: 0.907451 Mar 05 02:54:19.808148 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 133/258] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:54:18 2022] GET /compute/v2.1/servers/d0080e4b-6532-4e0c-8d19-cfbdf32e401b => generated 1724 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 02:54:19.822913 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-259234e7-11f5-441a-a36c-04fa158d6dae tempest-VolumesSnapshotTestJSON-729970751 tempest-VolumesSnapshotTestJSON-729970751-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:54:19.823824 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-259234e7-11f5-441a-a36c-04fa158d6dae tempest-VolumesSnapshotTestJSON-729970751 tempest-VolumesSnapshotTestJSON-729970751-project] [instance: b89e62f7-7ccc-48a6-ad76-88f6e022fe95] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:54:19.830596 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-259234e7-11f5-441a-a36c-04fa158d6dae tempest-VolumesSnapshotTestJSON-729970751 tempest-VolumesSnapshotTestJSON-729970751-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:19.831288 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-259234e7-11f5-441a-a36c-04fa158d6dae tempest-VolumesSnapshotTestJSON-729970751 tempest-VolumesSnapshotTestJSON-729970751-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:19.832549 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-259234e7-11f5-441a-a36c-04fa158d6dae tempest-VolumesSnapshotTestJSON-729970751 tempest-VolumesSnapshotTestJSON-729970751-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:19.833165 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-259234e7-11f5-441a-a36c-04fa158d6dae tempest-VolumesSnapshotTestJSON-729970751 tempest-VolumesSnapshotTestJSON-729970751-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:20.377275 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-d60d42fe-0875-4bee-87d6-ee19de3cb4a4 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90033e5e8e634b699bf050e36519f8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8112a5759c444c1f94be24ab61bf072f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:54:20.387293 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-d60d42fe-0875-4bee-87d6-ee19de3cb4a4 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] 10.222.0.26 "GET /compute/v2.1/servers/c24fee69-5bf4-40f4-ba18-56aecd12dd96" status: 200 len: 1514 microversion: 2.1 time: 0.917177 Mar 05 02:54:20.387978 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 126/259] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:54:19 2022] GET /compute/v2.1/servers/c24fee69-5bf4-40f4-ba18-56aecd12dd96 => generated 1514 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 02:54:20.396407 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-a71354ca-ebc0-4953-8144-430b80a1d7dd tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:54:20.397318 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-a71354ca-ebc0-4953-8144-430b80a1d7dd tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] [instance: d73f2b8e-9af1-4395-9995-f34cd8187681] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:54:20.404122 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-a71354ca-ebc0-4953-8144-430b80a1d7dd tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:20.404971 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-a71354ca-ebc0-4953-8144-430b80a1d7dd tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:20.405995 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-a71354ca-ebc0-4953-8144-430b80a1d7dd tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:20.406662 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-a71354ca-ebc0-4953-8144-430b80a1d7dd tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:20.541826 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-259234e7-11f5-441a-a36c-04fa158d6dae tempest-VolumesSnapshotTestJSON-729970751 tempest-VolumesSnapshotTestJSON-729970751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84de0440c1444309d9c9b6c706bae73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8efa5f5dbc9f460aa91f4f62eb57abee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:54:20.552538 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-259234e7-11f5-441a-a36c-04fa158d6dae tempest-VolumesSnapshotTestJSON-729970751 tempest-VolumesSnapshotTestJSON-729970751-project] 10.222.0.26 "GET /compute/v2.1/servers/b89e62f7-7ccc-48a6-ad76-88f6e022fe95" status: 200 len: 1318 microversion: 2.1 time: 0.736444 Mar 05 02:54:20.553379 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 134/260] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:54:19 2022] GET /compute/v2.1/servers/b89e62f7-7ccc-48a6-ad76-88f6e022fe95 => generated 1318 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 02:54:20.565209 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-d9dc466e-fa3e-4221-9d62-1ef357e36bde tempest-VolumesNegativeTest-1423831724 tempest-VolumesNegativeTest-1423831724-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:54:20.566133 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-d9dc466e-fa3e-4221-9d62-1ef357e36bde tempest-VolumesNegativeTest-1423831724 tempest-VolumesNegativeTest-1423831724-project] [instance: a8a27b43-73c6-4d5a-87ee-888eda8d677b] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:54:20.588231 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-d9dc466e-fa3e-4221-9d62-1ef357e36bde tempest-VolumesNegativeTest-1423831724 tempest-VolumesNegativeTest-1423831724-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:20.589494 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-d9dc466e-fa3e-4221-9d62-1ef357e36bde tempest-VolumesNegativeTest-1423831724 tempest-VolumesNegativeTest-1423831724-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:20.590311 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-d9dc466e-fa3e-4221-9d62-1ef357e36bde tempest-VolumesNegativeTest-1423831724 tempest-VolumesNegativeTest-1423831724-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:20.590913 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-d9dc466e-fa3e-4221-9d62-1ef357e36bde tempest-VolumesNegativeTest-1423831724 tempest-VolumesNegativeTest-1423831724-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:20.759574 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-d9dc466e-fa3e-4221-9d62-1ef357e36bde tempest-VolumesNegativeTest-1423831724 tempest-VolumesNegativeTest-1423831724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2097ae8dee5b4d17a4f4921393c3e70f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6d0875d975e453cab8434d214003ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:54:20.776822 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-d9dc466e-fa3e-4221-9d62-1ef357e36bde tempest-VolumesNegativeTest-1423831724 tempest-VolumesNegativeTest-1423831724-project] 10.222.0.26 "GET /compute/v2.1/servers/a8a27b43-73c6-4d5a-87ee-888eda8d677b" status: 200 len: 1266 microversion: 2.1 time: 0.213225 Mar 05 02:54:20.779090 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 135/261] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:54:20 2022] GET /compute/v2.1/servers/a8a27b43-73c6-4d5a-87ee-888eda8d677b => generated 1266 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 02:54:20.794564 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-e0546079-d54d-44de-b80c-3e897ac83f1d tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:54:20.795657 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-e0546079-d54d-44de-b80c-3e897ac83f1d tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] [instance: e28e570d-3d50-4fe8-bb4a-fe0e95c20fb7] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:54:20.808057 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-e0546079-d54d-44de-b80c-3e897ac83f1d tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:20.809486 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-e0546079-d54d-44de-b80c-3e897ac83f1d tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:20.818299 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-e0546079-d54d-44de-b80c-3e897ac83f1d tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:20.819067 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-e0546079-d54d-44de-b80c-3e897ac83f1d tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:21.253889 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-a71354ca-ebc0-4953-8144-430b80a1d7dd tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1700aa8052b94f878886b08f94f05831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3afb5b14217e4a54ab03e6233f8aaa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:54:21.265871 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-a71354ca-ebc0-4953-8144-430b80a1d7dd tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] 10.222.0.26 "GET /compute/v2.1/servers/d73f2b8e-9af1-4395-9995-f34cd8187681" status: 200 len: 1313 microversion: 2.1 time: 0.875325 Mar 05 02:54:21.270090 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 127/262] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:54:20 2022] GET /compute/v2.1/servers/d73f2b8e-9af1-4395-9995-f34cd8187681 => generated 1313 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 02:54:21.279705 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [req-a4a4bb33-a280-4ea5-96a5-ec6f7a4e59fa req-9fdb3814-4255-43ee-a391-79f6b1e8e189 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b89e62f7-7ccc-48a6-ad76-88f6e022fe95", "tag": "1165b4f9-8e23-488c-bf07-4804d1f8bb98"}]} {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 02:54:21.294751 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [req-a4a4bb33-a280-4ea5-96a5-ec6f7a4e59fa req-9fdb3814-4255-43ee-a391-79f6b1e8e189 service nova] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:21.298019 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [req-a4a4bb33-a280-4ea5-96a5-ec6f7a4e59fa req-9fdb3814-4255-43ee-a391-79f6b1e8e189 service nova] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:21.322075 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.compute.server_external_events [req-a4a4bb33-a280-4ea5-96a5-ec6f7a4e59fa req-9fdb3814-4255-43ee-a391-79f6b1e8e189 service nova] Creating event network-changed:1165b4f9-8e23-488c-bf07-4804d1f8bb98 for instance b89e62f7-7ccc-48a6-ad76-88f6e022fe95 on hv-cinder-82725 Mar 05 02:54:21.329261 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [req-a4a4bb33-a280-4ea5-96a5-ec6f7a4e59fa req-9fdb3814-4255-43ee-a391-79f6b1e8e189 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056259 Mar 05 02:54:21.330268 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 128/263] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Mar 5 02:54:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 02:54:21.336249 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-ed5ae286-0858-42e6-aaf8-7db63609cc58 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8ab37bc3-110b-43f6-a635-fa84fa57fec4"}} {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 02:54:21.338855 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-ed5ae286-0858-42e6-aaf8-7db63609cc58 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] [instance: c24fee69-5bf4-40f4-ba18-56aecd12dd96] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:54:21.348562 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-ed5ae286-0858-42e6-aaf8-7db63609cc58 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:21.350872 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-ed5ae286-0858-42e6-aaf8-7db63609cc58 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:21.352846 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-ed5ae286-0858-42e6-aaf8-7db63609cc58 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:21.353539 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-ed5ae286-0858-42e6-aaf8-7db63609cc58 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:21.591918 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-e0546079-d54d-44de-b80c-3e897ac83f1d tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:54:21.606592 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-e0546079-d54d-44de-b80c-3e897ac83f1d tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:54:21.609107 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-e0546079-d54d-44de-b80c-3e897ac83f1d tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:54:21.610582 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-e0546079-d54d-44de-b80c-3e897ac83f1d tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] 10.222.0.26 "GET /compute/v2.1/servers/e28e570d-3d50-4fe8-bb4a-fe0e95c20fb7" status: 200 len: 1739 microversion: 2.20 time: 0.826836 Mar 05 02:54:21.622144 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 136/264] 10.222.0.26 () {60 vars in 1276 bytes} [Sat Mar 5 02:54:20 2022] GET /compute/v2.1/servers/e28e570d-3d50-4fe8-bb4a-fe0e95c20fb7 => generated 1739 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 02:54:21.649353 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-87ef0afb-dc8d-463e-84dd-7524ec67035e tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:54:21.651327 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-87ef0afb-dc8d-463e-84dd-7524ec67035e tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] [instance: d0080e4b-6532-4e0c-8d19-cfbdf32e401b] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:54:21.669405 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-87ef0afb-dc8d-463e-84dd-7524ec67035e tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:21.670010 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-87ef0afb-dc8d-463e-84dd-7524ec67035e tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:21.671099 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-87ef0afb-dc8d-463e-84dd-7524ec67035e tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:21.671617 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-87ef0afb-dc8d-463e-84dd-7524ec67035e tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:21.875140 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-ed5ae286-0858-42e6-aaf8-7db63609cc58 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] 10.222.0.26 "POST /compute/v2.1/servers/c24fee69-5bf4-40f4-ba18-56aecd12dd96/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.539379 Mar 05 02:54:21.876574 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 129/265] 10.222.0.26 () {60 vars in 1322 bytes} [Sat Mar 5 02:54:21 2022] POST /compute/v2.1/servers/c24fee69-5bf4-40f4-ba18-56aecd12dd96/os-volume_attachments => generated 194 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 02:54:21.896998 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-19931738-f829-4b80-b981-835c04a56ce1 tempest-VolumesSnapshotTestJSON-729970751 tempest-VolumesSnapshotTestJSON-729970751-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:54:21.898329 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-19931738-f829-4b80-b981-835c04a56ce1 tempest-VolumesSnapshotTestJSON-729970751 tempest-VolumesSnapshotTestJSON-729970751-project] [instance: b89e62f7-7ccc-48a6-ad76-88f6e022fe95] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:54:21.919024 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-19931738-f829-4b80-b981-835c04a56ce1 tempest-VolumesSnapshotTestJSON-729970751 tempest-VolumesSnapshotTestJSON-729970751-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:21.922216 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-19931738-f829-4b80-b981-835c04a56ce1 tempest-VolumesSnapshotTestJSON-729970751 tempest-VolumesSnapshotTestJSON-729970751-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:21.923610 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-19931738-f829-4b80-b981-835c04a56ce1 tempest-VolumesSnapshotTestJSON-729970751 tempest-VolumesSnapshotTestJSON-729970751-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:21.924362 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-19931738-f829-4b80-b981-835c04a56ce1 tempest-VolumesSnapshotTestJSON-729970751 tempest-VolumesSnapshotTestJSON-729970751-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:22.723905 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-87ef0afb-dc8d-463e-84dd-7524ec67035e tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e5a000087fe40419ccd0d1a96fb4783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9d27da2e71d4962a53a95efc46518ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:54:22.736903 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-87ef0afb-dc8d-463e-84dd-7524ec67035e tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] 10.222.0.26 "GET /compute/v2.1/servers/d0080e4b-6532-4e0c-8d19-cfbdf32e401b" status: 200 len: 1724 microversion: 2.1 time: 1.113560 Mar 05 02:54:22.757853 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 137/266] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:54:21 2022] GET /compute/v2.1/servers/d0080e4b-6532-4e0c-8d19-cfbdf32e401b => generated 1724 bytes in 1135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 02:54:22.763166 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-0f22970d-154c-4740-85e7-94e2ce098cf6 tempest-VolumesNegativeTest-1423831724 tempest-VolumesNegativeTest-1423831724-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:54:22.764042 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-0f22970d-154c-4740-85e7-94e2ce098cf6 tempest-VolumesNegativeTest-1423831724 tempest-VolumesNegativeTest-1423831724-project] [instance: a8a27b43-73c6-4d5a-87ee-888eda8d677b] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:54:22.779987 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-0f22970d-154c-4740-85e7-94e2ce098cf6 tempest-VolumesNegativeTest-1423831724 tempest-VolumesNegativeTest-1423831724-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:22.780434 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-0f22970d-154c-4740-85e7-94e2ce098cf6 tempest-VolumesNegativeTest-1423831724 tempest-VolumesNegativeTest-1423831724-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:22.784704 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-0f22970d-154c-4740-85e7-94e2ce098cf6 tempest-VolumesNegativeTest-1423831724 tempest-VolumesNegativeTest-1423831724-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:22.785366 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-0f22970d-154c-4740-85e7-94e2ce098cf6 tempest-VolumesNegativeTest-1423831724 tempest-VolumesNegativeTest-1423831724-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:22.892125 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-19931738-f829-4b80-b981-835c04a56ce1 tempest-VolumesSnapshotTestJSON-729970751 tempest-VolumesSnapshotTestJSON-729970751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84de0440c1444309d9c9b6c706bae73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8efa5f5dbc9f460aa91f4f62eb57abee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:54:22.905980 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-19931738-f829-4b80-b981-835c04a56ce1 tempest-VolumesSnapshotTestJSON-729970751 tempest-VolumesSnapshotTestJSON-729970751-project] 10.222.0.26 "GET /compute/v2.1/servers/b89e62f7-7ccc-48a6-ad76-88f6e022fe95" status: 200 len: 1318 microversion: 2.1 time: 1.018843 Mar 05 02:54:22.918675 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 130/267] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:54:21 2022] GET /compute/v2.1/servers/b89e62f7-7ccc-48a6-ad76-88f6e022fe95 => generated 1318 bytes in 1036 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 02:54:22.931255 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-d75f8b3a-38da-4e8c-85a0-aacdad8dd6ce tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:54:22.936676 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-d75f8b3a-38da-4e8c-85a0-aacdad8dd6ce tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] [instance: d73f2b8e-9af1-4395-9995-f34cd8187681] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:54:22.961197 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-d75f8b3a-38da-4e8c-85a0-aacdad8dd6ce tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:22.961896 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-d75f8b3a-38da-4e8c-85a0-aacdad8dd6ce tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:22.964948 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-d75f8b3a-38da-4e8c-85a0-aacdad8dd6ce tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:22.967412 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-d75f8b3a-38da-4e8c-85a0-aacdad8dd6ce tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:23.610926 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-0f22970d-154c-4740-85e7-94e2ce098cf6 tempest-VolumesNegativeTest-1423831724 tempest-VolumesNegativeTest-1423831724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2097ae8dee5b4d17a4f4921393c3e70f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6d0875d975e453cab8434d214003ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:54:23.647085 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-0f22970d-154c-4740-85e7-94e2ce098cf6 tempest-VolumesNegativeTest-1423831724 tempest-VolumesNegativeTest-1423831724-project] 10.222.0.26 "GET /compute/v2.1/servers/a8a27b43-73c6-4d5a-87ee-888eda8d677b" status: 200 len: 1314 microversion: 2.1 time: 0.886403 Mar 05 02:54:23.648919 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 138/268] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:54:22 2022] GET /compute/v2.1/servers/a8a27b43-73c6-4d5a-87ee-888eda8d677b => generated 1314 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 02:54:23.666122 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-21435e32-84d5-4d97-b579-6de893f9f3a6 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:54:23.668025 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-21435e32-84d5-4d97-b579-6de893f9f3a6 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] [instance: e28e570d-3d50-4fe8-bb4a-fe0e95c20fb7] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:54:23.686996 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-d75f8b3a-38da-4e8c-85a0-aacdad8dd6ce tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1700aa8052b94f878886b08f94f05831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3afb5b14217e4a54ab03e6233f8aaa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:54:23.689934 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-21435e32-84d5-4d97-b579-6de893f9f3a6 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:23.692572 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-21435e32-84d5-4d97-b579-6de893f9f3a6 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:23.695286 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-21435e32-84d5-4d97-b579-6de893f9f3a6 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:23.695891 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-21435e32-84d5-4d97-b579-6de893f9f3a6 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:23.704522 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-d75f8b3a-38da-4e8c-85a0-aacdad8dd6ce tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] 10.222.0.26 "GET /compute/v2.1/servers/d73f2b8e-9af1-4395-9995-f34cd8187681" status: 200 len: 1313 microversion: 2.1 time: 0.783108 Mar 05 02:54:23.705112 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 131/269] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:54:22 2022] GET /compute/v2.1/servers/d73f2b8e-9af1-4395-9995-f34cd8187681 => generated 1313 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 02:54:24.050363 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-b7d828e8-c87d-4041-9c4c-18c6708feea1 tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] Action: 'create', calling method: .version_select at 0x7f3f628cd430>, body: {"keypair": {"name": "tempest-TestShelveInstance-320980881"}} {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 02:54:24.098026 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.quota [None req-b7d828e8-c87d-4041-9c4c-18c6708feea1 tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] Getting quotas for project 47835ba5de1a42cc94c09b33a187868a. Resources: {'key_pairs'} {{(pid=123546) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 02:54:24.114578 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.quota [None req-b7d828e8-c87d-4041-9c4c-18c6708feea1 tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] Getting quotas for user 4c68b816379942e282577e3d8d624ae1 and project 47835ba5de1a42cc94c09b33a187868a. Resources: {'key_pairs'} {{(pid=123546) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 02:54:24.176989 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-21435e32-84d5-4d97-b579-6de893f9f3a6 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:54:24.197114 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-21435e32-84d5-4d97-b579-6de893f9f3a6 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:54:24.198785 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-21435e32-84d5-4d97-b579-6de893f9f3a6 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:54:24.199984 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-21435e32-84d5-4d97-b579-6de893f9f3a6 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] 10.222.0.26 "GET /compute/v2.1/servers/e28e570d-3d50-4fe8-bb4a-fe0e95c20fb7" status: 200 len: 1739 microversion: 2.20 time: 0.550004 Mar 05 02:54:24.200547 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 139/270] 10.222.0.26 () {60 vars in 1276 bytes} [Sat Mar 5 02:54:23 2022] GET /compute/v2.1/servers/e28e570d-3d50-4fe8-bb4a-fe0e95c20fb7 => generated 1739 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 02:54:24.234643 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [req-0267bc20-44e2-43b8-9aa9-a1de9f70f63a req-28dbbfb0-2dd9-4952-9fc2-f3a025a13e5e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d73f2b8e-9af1-4395-9995-f34cd8187681", "tag": "63cfcfd4-050a-4cef-9d98-a1860af5f5ca"}]} {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 02:54:24.254464 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [req-0267bc20-44e2-43b8-9aa9-a1de9f70f63a req-28dbbfb0-2dd9-4952-9fc2-f3a025a13e5e service nova] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:24.261757 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [req-0267bc20-44e2-43b8-9aa9-a1de9f70f63a req-28dbbfb0-2dd9-4952-9fc2-f3a025a13e5e service nova] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:24.305330 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.compute.server_external_events [req-0267bc20-44e2-43b8-9aa9-a1de9f70f63a req-28dbbfb0-2dd9-4952-9fc2-f3a025a13e5e service nova] Creating event network-changed:63cfcfd4-050a-4cef-9d98-a1860af5f5ca for instance d73f2b8e-9af1-4395-9995-f34cd8187681 on hv-cinder-82725 Mar 05 02:54:24.322415 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [req-0267bc20-44e2-43b8-9aa9-a1de9f70f63a req-28dbbfb0-2dd9-4952-9fc2-f3a025a13e5e service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.120052 Mar 05 02:54:24.323035 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 140/271] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Mar 5 02:54:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 02:54:24.348064 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [req-cc317099-23b3-4f6b-a4a6-cd5f8707201a req-5ff7f83b-7d96-466a-8449-d23a0d4a6406 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a8a27b43-73c6-4d5a-87ee-888eda8d677b", "tag": "67df0ed3-4a7f-4353-a18d-274a902ce784"}]} {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 02:54:24.392322 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [req-cc317099-23b3-4f6b-a4a6-cd5f8707201a req-5ff7f83b-7d96-466a-8449-d23a0d4a6406 service nova] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:24.392784 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [req-cc317099-23b3-4f6b-a4a6-cd5f8707201a req-5ff7f83b-7d96-466a-8449-d23a0d4a6406 service nova] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:24.413533 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.compute.server_external_events [req-cc317099-23b3-4f6b-a4a6-cd5f8707201a req-5ff7f83b-7d96-466a-8449-d23a0d4a6406 service nova] Creating event network-changed:67df0ed3-4a7f-4353-a18d-274a902ce784 for instance a8a27b43-73c6-4d5a-87ee-888eda8d677b on hv-cinder-82725 Mar 05 02:54:24.420875 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [req-cc317099-23b3-4f6b-a4a6-cd5f8707201a req-5ff7f83b-7d96-466a-8449-d23a0d4a6406 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096242 Mar 05 02:54:24.421755 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 141/272] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Mar 5 02:54:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 02:54:24.428809 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-13aedf16-8c56-48a6-bd6c-1bc7a91771f4 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:54:24.429789 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-13aedf16-8c56-48a6-bd6c-1bc7a91771f4 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] [instance: d0080e4b-6532-4e0c-8d19-cfbdf32e401b] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:54:24.437942 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-13aedf16-8c56-48a6-bd6c-1bc7a91771f4 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:24.440479 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.quota [None req-b7d828e8-c87d-4041-9c4c-18c6708feea1 tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] Getting quotas for project 47835ba5de1a42cc94c09b33a187868a. Resources: {'key_pairs'} {{(pid=123546) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 02:54:24.440686 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-13aedf16-8c56-48a6-bd6c-1bc7a91771f4 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:24.441657 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-13aedf16-8c56-48a6-bd6c-1bc7a91771f4 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:24.445980 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-13aedf16-8c56-48a6-bd6c-1bc7a91771f4 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:24.452809 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.quota [None req-b7d828e8-c87d-4041-9c4c-18c6708feea1 tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] Getting quotas for user 4c68b816379942e282577e3d8d624ae1 and project 47835ba5de1a42cc94c09b33a187868a. Resources: {'key_pairs'} {{(pid=123546) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 02:54:24.481827 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-b7d828e8-c87d-4041-9c4c-18c6708feea1 tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 2315 microversion: 2.1 time: 0.775504 Mar 05 02:54:24.489134 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 132/273] 10.222.0.26 () {60 vars in 1157 bytes} [Sat Mar 5 02:54:23 2022] POST /compute/v2.1/os-keypairs => generated 2315 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 02:54:24.496814 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-7c86445d-a33a-414b-804d-f40a866dce38 tempest-VolumesSnapshotTestJSON-729970751 tempest-VolumesSnapshotTestJSON-729970751-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:54:24.501384 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-7c86445d-a33a-414b-804d-f40a866dce38 tempest-VolumesSnapshotTestJSON-729970751 tempest-VolumesSnapshotTestJSON-729970751-project] [instance: b89e62f7-7ccc-48a6-ad76-88f6e022fe95] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:54:24.516109 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-7c86445d-a33a-414b-804d-f40a866dce38 tempest-VolumesSnapshotTestJSON-729970751 tempest-VolumesSnapshotTestJSON-729970751-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:24.519904 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-7c86445d-a33a-414b-804d-f40a866dce38 tempest-VolumesSnapshotTestJSON-729970751 tempest-VolumesSnapshotTestJSON-729970751-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:24.520735 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-7c86445d-a33a-414b-804d-f40a866dce38 tempest-VolumesSnapshotTestJSON-729970751 tempest-VolumesSnapshotTestJSON-729970751-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:24.522554 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-7c86445d-a33a-414b-804d-f40a866dce38 tempest-VolumesSnapshotTestJSON-729970751 tempest-VolumesSnapshotTestJSON-729970751-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:25.048574 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-13aedf16-8c56-48a6-bd6c-1bc7a91771f4 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e5a000087fe40419ccd0d1a96fb4783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9d27da2e71d4962a53a95efc46518ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:54:25.057072 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-13aedf16-8c56-48a6-bd6c-1bc7a91771f4 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] 10.222.0.26 "GET /compute/v2.1/servers/d0080e4b-6532-4e0c-8d19-cfbdf32e401b" status: 200 len: 1724 microversion: 2.1 time: 0.633883 Mar 05 02:54:25.057654 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 142/274] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:54:24 2022] GET /compute/v2.1/servers/d0080e4b-6532-4e0c-8d19-cfbdf32e401b => generated 1724 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 02:54:25.070042 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-186d7f93-fc08-4416-8266-497deb41720f tempest-VolumesNegativeTest-1423831724 tempest-VolumesNegativeTest-1423831724-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:54:25.072341 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-186d7f93-fc08-4416-8266-497deb41720f tempest-VolumesNegativeTest-1423831724 tempest-VolumesNegativeTest-1423831724-project] [instance: a8a27b43-73c6-4d5a-87ee-888eda8d677b] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:54:25.088501 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-186d7f93-fc08-4416-8266-497deb41720f tempest-VolumesNegativeTest-1423831724 tempest-VolumesNegativeTest-1423831724-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:25.092208 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-186d7f93-fc08-4416-8266-497deb41720f tempest-VolumesNegativeTest-1423831724 tempest-VolumesNegativeTest-1423831724-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:25.095618 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-186d7f93-fc08-4416-8266-497deb41720f tempest-VolumesNegativeTest-1423831724 tempest-VolumesNegativeTest-1423831724-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:25.096259 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-186d7f93-fc08-4416-8266-497deb41720f tempest-VolumesNegativeTest-1423831724 tempest-VolumesNegativeTest-1423831724-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:25.157717 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-7c86445d-a33a-414b-804d-f40a866dce38 tempest-VolumesSnapshotTestJSON-729970751 tempest-VolumesSnapshotTestJSON-729970751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84de0440c1444309d9c9b6c706bae73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8efa5f5dbc9f460aa91f4f62eb57abee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:54:25.169247 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-7c86445d-a33a-414b-804d-f40a866dce38 tempest-VolumesSnapshotTestJSON-729970751 tempest-VolumesSnapshotTestJSON-729970751-project] 10.222.0.26 "GET /compute/v2.1/servers/b89e62f7-7ccc-48a6-ad76-88f6e022fe95" status: 200 len: 1318 microversion: 2.1 time: 0.678607 Mar 05 02:54:25.171461 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 133/275] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:54:24 2022] GET /compute/v2.1/servers/b89e62f7-7ccc-48a6-ad76-88f6e022fe95 => generated 1318 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 02:54:25.181947 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-8f367622-f8dd-488b-bd2e-cf77609b02de tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:54:25.182934 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-8f367622-f8dd-488b-bd2e-cf77609b02de tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] [instance: d73f2b8e-9af1-4395-9995-f34cd8187681] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:54:25.202097 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-8f367622-f8dd-488b-bd2e-cf77609b02de tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:25.202851 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-8f367622-f8dd-488b-bd2e-cf77609b02de tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:25.203790 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-8f367622-f8dd-488b-bd2e-cf77609b02de tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:25.204375 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-8f367622-f8dd-488b-bd2e-cf77609b02de tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:25.681389 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-186d7f93-fc08-4416-8266-497deb41720f tempest-VolumesNegativeTest-1423831724 tempest-VolumesNegativeTest-1423831724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2097ae8dee5b4d17a4f4921393c3e70f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6d0875d975e453cab8434d214003ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:54:25.693971 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-186d7f93-fc08-4416-8266-497deb41720f tempest-VolumesNegativeTest-1423831724 tempest-VolumesNegativeTest-1423831724-project] 10.222.0.26 "GET /compute/v2.1/servers/a8a27b43-73c6-4d5a-87ee-888eda8d677b" status: 200 len: 1314 microversion: 2.1 time: 0.627434 Mar 05 02:54:25.694666 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 143/276] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:54:25 2022] GET /compute/v2.1/servers/a8a27b43-73c6-4d5a-87ee-888eda8d677b => generated 1314 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 02:54:25.706957 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-b29c4eb3-b337-4ff8-94df-204969f2e687 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:54:25.710231 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-b29c4eb3-b337-4ff8-94df-204969f2e687 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] [instance: e28e570d-3d50-4fe8-bb4a-fe0e95c20fb7] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:54:25.728009 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-b29c4eb3-b337-4ff8-94df-204969f2e687 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:25.730527 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-b29c4eb3-b337-4ff8-94df-204969f2e687 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:25.731441 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-b29c4eb3-b337-4ff8-94df-204969f2e687 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:25.731894 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-b29c4eb3-b337-4ff8-94df-204969f2e687 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:25.754119 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-8f367622-f8dd-488b-bd2e-cf77609b02de tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1700aa8052b94f878886b08f94f05831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3afb5b14217e4a54ab03e6233f8aaa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:54:25.761605 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-8f367622-f8dd-488b-bd2e-cf77609b02de tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] 10.222.0.26 "GET /compute/v2.1/servers/d73f2b8e-9af1-4395-9995-f34cd8187681" status: 200 len: 1313 microversion: 2.1 time: 0.588828 Mar 05 02:54:25.762227 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 134/277] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:54:25 2022] GET /compute/v2.1/servers/d73f2b8e-9af1-4395-9995-f34cd8187681 => generated 1313 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 02:54:26.075475 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-b5d08199-1072-4ab8-ae01-0dad5db86be0 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:54:26.077017 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-b5d08199-1072-4ab8-ae01-0dad5db86be0 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] [instance: d0080e4b-6532-4e0c-8d19-cfbdf32e401b] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:54:26.088856 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-b5d08199-1072-4ab8-ae01-0dad5db86be0 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:26.090496 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-b5d08199-1072-4ab8-ae01-0dad5db86be0 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:26.093242 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-b5d08199-1072-4ab8-ae01-0dad5db86be0 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:26.094533 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-b5d08199-1072-4ab8-ae01-0dad5db86be0 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:26.552403 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-b29c4eb3-b337-4ff8-94df-204969f2e687 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:54:26.567206 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-b29c4eb3-b337-4ff8-94df-204969f2e687 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:54:26.571920 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-b29c4eb3-b337-4ff8-94df-204969f2e687 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:54:26.577671 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-b29c4eb3-b337-4ff8-94df-204969f2e687 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] 10.222.0.26 "GET /compute/v2.1/servers/e28e570d-3d50-4fe8-bb4a-fe0e95c20fb7" status: 200 len: 1739 microversion: 2.20 time: 0.881941 Mar 05 02:54:26.599399 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 144/278] 10.222.0.26 () {60 vars in 1276 bytes} [Sat Mar 5 02:54:25 2022] GET /compute/v2.1/servers/e28e570d-3d50-4fe8-bb4a-fe0e95c20fb7 => generated 1739 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 02:54:26.604829 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-e368053e-7bf8-4422-ba56-2b901ecdbf25 tempest-VolumesSnapshotTestJSON-729970751 tempest-VolumesSnapshotTestJSON-729970751-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:54:26.609990 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-e368053e-7bf8-4422-ba56-2b901ecdbf25 tempest-VolumesSnapshotTestJSON-729970751 tempest-VolumesSnapshotTestJSON-729970751-project] [instance: b89e62f7-7ccc-48a6-ad76-88f6e022fe95] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:54:26.626188 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-b5d08199-1072-4ab8-ae01-0dad5db86be0 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e5a000087fe40419ccd0d1a96fb4783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9d27da2e71d4962a53a95efc46518ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:54:26.627198 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-e368053e-7bf8-4422-ba56-2b901ecdbf25 tempest-VolumesSnapshotTestJSON-729970751 tempest-VolumesSnapshotTestJSON-729970751-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:26.632657 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-e368053e-7bf8-4422-ba56-2b901ecdbf25 tempest-VolumesSnapshotTestJSON-729970751 tempest-VolumesSnapshotTestJSON-729970751-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:26.635919 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-e368053e-7bf8-4422-ba56-2b901ecdbf25 tempest-VolumesSnapshotTestJSON-729970751 tempest-VolumesSnapshotTestJSON-729970751-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:26.636536 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-e368053e-7bf8-4422-ba56-2b901ecdbf25 tempest-VolumesSnapshotTestJSON-729970751 tempest-VolumesSnapshotTestJSON-729970751-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:26.656784 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-b5d08199-1072-4ab8-ae01-0dad5db86be0 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] 10.222.0.26 "GET /compute/v2.1/servers/d0080e4b-6532-4e0c-8d19-cfbdf32e401b" status: 200 len: 1724 microversion: 2.1 time: 0.585914 Mar 05 02:54:26.666879 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 135/279] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:54:26 2022] GET /compute/v2.1/servers/d0080e4b-6532-4e0c-8d19-cfbdf32e401b => generated 1724 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 02:54:26.718721 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-bfdbe75f-8816-4fa8-a15c-b47930ccb64e tempest-VolumesNegativeTest-1423831724 tempest-VolumesNegativeTest-1423831724-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:54:26.719344 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-bfdbe75f-8816-4fa8-a15c-b47930ccb64e tempest-VolumesNegativeTest-1423831724 tempest-VolumesNegativeTest-1423831724-project] [instance: a8a27b43-73c6-4d5a-87ee-888eda8d677b] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:54:26.751880 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-bfdbe75f-8816-4fa8-a15c-b47930ccb64e tempest-VolumesNegativeTest-1423831724 tempest-VolumesNegativeTest-1423831724-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:26.752574 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-bfdbe75f-8816-4fa8-a15c-b47930ccb64e tempest-VolumesNegativeTest-1423831724 tempest-VolumesNegativeTest-1423831724-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:26.753106 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-bfdbe75f-8816-4fa8-a15c-b47930ccb64e tempest-VolumesNegativeTest-1423831724 tempest-VolumesNegativeTest-1423831724-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:26.753536 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-bfdbe75f-8816-4fa8-a15c-b47930ccb64e tempest-VolumesNegativeTest-1423831724 tempest-VolumesNegativeTest-1423831724-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:27.114745 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-e368053e-7bf8-4422-ba56-2b901ecdbf25 tempest-VolumesSnapshotTestJSON-729970751 tempest-VolumesSnapshotTestJSON-729970751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84de0440c1444309d9c9b6c706bae73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8efa5f5dbc9f460aa91f4f62eb57abee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:54:27.122036 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-e368053e-7bf8-4422-ba56-2b901ecdbf25 tempest-VolumesSnapshotTestJSON-729970751 tempest-VolumesSnapshotTestJSON-729970751-project] 10.222.0.26 "GET /compute/v2.1/servers/b89e62f7-7ccc-48a6-ad76-88f6e022fe95" status: 200 len: 1318 microversion: 2.1 time: 0.521208 Mar 05 02:54:27.131982 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 145/280] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:54:26 2022] GET /compute/v2.1/servers/b89e62f7-7ccc-48a6-ad76-88f6e022fe95 => generated 1318 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 02:54:27.135698 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-b3ffda23-d47d-47b6-9ba2-ba7d4c090516 tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:54:27.136306 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-b3ffda23-d47d-47b6-9ba2-ba7d4c090516 tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] [instance: d73f2b8e-9af1-4395-9995-f34cd8187681] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:54:27.155488 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-b3ffda23-d47d-47b6-9ba2-ba7d4c090516 tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:27.155945 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-b3ffda23-d47d-47b6-9ba2-ba7d4c090516 tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:27.156731 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-b3ffda23-d47d-47b6-9ba2-ba7d4c090516 tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:27.160211 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-b3ffda23-d47d-47b6-9ba2-ba7d4c090516 tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:27.178156 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-bfdbe75f-8816-4fa8-a15c-b47930ccb64e tempest-VolumesNegativeTest-1423831724 tempest-VolumesNegativeTest-1423831724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2097ae8dee5b4d17a4f4921393c3e70f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6d0875d975e453cab8434d214003ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:54:27.185457 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-bfdbe75f-8816-4fa8-a15c-b47930ccb64e tempest-VolumesNegativeTest-1423831724 tempest-VolumesNegativeTest-1423831724-project] 10.222.0.26 "GET /compute/v2.1/servers/a8a27b43-73c6-4d5a-87ee-888eda8d677b" status: 200 len: 1314 microversion: 2.1 time: 0.478602 Mar 05 02:54:27.192088 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 136/281] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:54:26 2022] GET /compute/v2.1/servers/a8a27b43-73c6-4d5a-87ee-888eda8d677b => generated 1314 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 02:54:27.414271 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-b3ffda23-d47d-47b6-9ba2-ba7d4c090516 tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1700aa8052b94f878886b08f94f05831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3afb5b14217e4a54ab03e6233f8aaa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:54:27.424474 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-b3ffda23-d47d-47b6-9ba2-ba7d4c090516 tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] 10.222.0.26 "GET /compute/v2.1/servers/d73f2b8e-9af1-4395-9995-f34cd8187681" status: 200 len: 1313 microversion: 2.1 time: 0.291872 Mar 05 02:54:27.425198 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 146/282] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:54:27 2022] GET /compute/v2.1/servers/d73f2b8e-9af1-4395-9995-f34cd8187681 => generated 1313 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 02:54:27.596674 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-241050a8-0422-4216-9530-100d3416e6a5 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:54:27.597292 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-241050a8-0422-4216-9530-100d3416e6a5 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] [instance: e28e570d-3d50-4fe8-bb4a-fe0e95c20fb7] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:54:27.617670 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-241050a8-0422-4216-9530-100d3416e6a5 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:27.618485 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-241050a8-0422-4216-9530-100d3416e6a5 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:27.621139 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-241050a8-0422-4216-9530-100d3416e6a5 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:27.623563 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-241050a8-0422-4216-9530-100d3416e6a5 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:27.683168 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-fe1ef21c-3a1d-4460-a65f-36d7f9ae5151 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:54:27.685169 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-fe1ef21c-3a1d-4460-a65f-36d7f9ae5151 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] [instance: d0080e4b-6532-4e0c-8d19-cfbdf32e401b] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:54:27.704334 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-fe1ef21c-3a1d-4460-a65f-36d7f9ae5151 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:27.705599 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-fe1ef21c-3a1d-4460-a65f-36d7f9ae5151 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:27.707247 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-fe1ef21c-3a1d-4460-a65f-36d7f9ae5151 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:27.707572 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-fe1ef21c-3a1d-4460-a65f-36d7f9ae5151 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:27.996404 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-241050a8-0422-4216-9530-100d3416e6a5 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:54:28.014917 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-241050a8-0422-4216-9530-100d3416e6a5 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:54:28.016501 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-241050a8-0422-4216-9530-100d3416e6a5 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:54:28.017701 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-241050a8-0422-4216-9530-100d3416e6a5 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] 10.222.0.26 "GET /compute/v2.1/servers/e28e570d-3d50-4fe8-bb4a-fe0e95c20fb7" status: 200 len: 1739 microversion: 2.20 time: 0.425415 Mar 05 02:54:28.022654 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 137/283] 10.222.0.26 () {60 vars in 1276 bytes} [Sat Mar 5 02:54:27 2022] GET /compute/v2.1/servers/e28e570d-3d50-4fe8-bb4a-fe0e95c20fb7 => generated 1739 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 02:54:28.069413 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-fe1ef21c-3a1d-4460-a65f-36d7f9ae5151 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e5a000087fe40419ccd0d1a96fb4783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9d27da2e71d4962a53a95efc46518ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:54:28.083299 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-fe1ef21c-3a1d-4460-a65f-36d7f9ae5151 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] 10.222.0.26 "GET /compute/v2.1/servers/d0080e4b-6532-4e0c-8d19-cfbdf32e401b" status: 200 len: 1724 microversion: 2.1 time: 0.404130 Mar 05 02:54:28.084308 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 147/284] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:54:27 2022] GET /compute/v2.1/servers/d0080e4b-6532-4e0c-8d19-cfbdf32e401b => generated 1724 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 02:54:28.142421 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-ddeaa97f-f368-4013-887b-e8e87bf35e9f tempest-VolumesSnapshotTestJSON-729970751 tempest-VolumesSnapshotTestJSON-729970751-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:54:28.143365 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-ddeaa97f-f368-4013-887b-e8e87bf35e9f tempest-VolumesSnapshotTestJSON-729970751 tempest-VolumesSnapshotTestJSON-729970751-project] [instance: b89e62f7-7ccc-48a6-ad76-88f6e022fe95] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:54:28.151000 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-ddeaa97f-f368-4013-887b-e8e87bf35e9f tempest-VolumesSnapshotTestJSON-729970751 tempest-VolumesSnapshotTestJSON-729970751-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:28.151741 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-ddeaa97f-f368-4013-887b-e8e87bf35e9f tempest-VolumesSnapshotTestJSON-729970751 tempest-VolumesSnapshotTestJSON-729970751-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:28.152605 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-ddeaa97f-f368-4013-887b-e8e87bf35e9f tempest-VolumesSnapshotTestJSON-729970751 tempest-VolumesSnapshotTestJSON-729970751-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:28.153181 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-ddeaa97f-f368-4013-887b-e8e87bf35e9f tempest-VolumesSnapshotTestJSON-729970751 tempest-VolumesSnapshotTestJSON-729970751-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:28.203269 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-1ed559c7-3d13-4c87-ac09-01da1b2790b3 tempest-VolumesNegativeTest-1423831724 tempest-VolumesNegativeTest-1423831724-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:54:28.204479 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-1ed559c7-3d13-4c87-ac09-01da1b2790b3 tempest-VolumesNegativeTest-1423831724 tempest-VolumesNegativeTest-1423831724-project] [instance: a8a27b43-73c6-4d5a-87ee-888eda8d677b] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:54:28.249516 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-1ed559c7-3d13-4c87-ac09-01da1b2790b3 tempest-VolumesNegativeTest-1423831724 tempest-VolumesNegativeTest-1423831724-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:28.253462 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-1ed559c7-3d13-4c87-ac09-01da1b2790b3 tempest-VolumesNegativeTest-1423831724 tempest-VolumesNegativeTest-1423831724-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:28.254794 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-1ed559c7-3d13-4c87-ac09-01da1b2790b3 tempest-VolumesNegativeTest-1423831724 tempest-VolumesNegativeTest-1423831724-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:28.258885 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-1ed559c7-3d13-4c87-ac09-01da1b2790b3 tempest-VolumesNegativeTest-1423831724 tempest-VolumesNegativeTest-1423831724-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:28.510465 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-ddeaa97f-f368-4013-887b-e8e87bf35e9f tempest-VolumesSnapshotTestJSON-729970751 tempest-VolumesSnapshotTestJSON-729970751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84de0440c1444309d9c9b6c706bae73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8efa5f5dbc9f460aa91f4f62eb57abee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:54:28.520845 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-ddeaa97f-f368-4013-887b-e8e87bf35e9f tempest-VolumesSnapshotTestJSON-729970751 tempest-VolumesSnapshotTestJSON-729970751-project] 10.222.0.26 "GET /compute/v2.1/servers/b89e62f7-7ccc-48a6-ad76-88f6e022fe95" status: 200 len: 1318 microversion: 2.1 time: 0.381713 Mar 05 02:54:28.532360 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 138/285] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:54:28 2022] GET /compute/v2.1/servers/b89e62f7-7ccc-48a6-ad76-88f6e022fe95 => generated 1318 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 02:54:28.537652 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-8eacaa62-db38-451d-a9d8-fb34919836fa tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:54:28.538567 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-8eacaa62-db38-451d-a9d8-fb34919836fa tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] [instance: d73f2b8e-9af1-4395-9995-f34cd8187681] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:54:28.545999 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-8eacaa62-db38-451d-a9d8-fb34919836fa tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:28.546524 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-8eacaa62-db38-451d-a9d8-fb34919836fa tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:28.547885 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-8eacaa62-db38-451d-a9d8-fb34919836fa tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:28.548421 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-8eacaa62-db38-451d-a9d8-fb34919836fa tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:28.590614 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-1ed559c7-3d13-4c87-ac09-01da1b2790b3 tempest-VolumesNegativeTest-1423831724 tempest-VolumesNegativeTest-1423831724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2097ae8dee5b4d17a4f4921393c3e70f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6d0875d975e453cab8434d214003ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:54:28.607992 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-1ed559c7-3d13-4c87-ac09-01da1b2790b3 tempest-VolumesNegativeTest-1423831724 tempest-VolumesNegativeTest-1423831724-project] 10.222.0.26 "GET /compute/v2.1/servers/a8a27b43-73c6-4d5a-87ee-888eda8d677b" status: 200 len: 1314 microversion: 2.1 time: 0.402928 Mar 05 02:54:28.608633 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 148/286] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:54:28 2022] GET /compute/v2.1/servers/a8a27b43-73c6-4d5a-87ee-888eda8d677b => generated 1314 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 02:54:28.800007 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-8eacaa62-db38-451d-a9d8-fb34919836fa tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1700aa8052b94f878886b08f94f05831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3afb5b14217e4a54ab03e6233f8aaa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:54:28.807288 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-8eacaa62-db38-451d-a9d8-fb34919836fa tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] 10.222.0.26 "GET /compute/v2.1/servers/d73f2b8e-9af1-4395-9995-f34cd8187681" status: 200 len: 1313 microversion: 2.1 time: 0.273731 Mar 05 02:54:28.807863 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 139/287] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:54:28 2022] GET /compute/v2.1/servers/d73f2b8e-9af1-4395-9995-f34cd8187681 => generated 1313 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 02:54:29.040866 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-8024a88b-90aa-4cb7-910e-e8270801bbcd tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:54:29.041412 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-8024a88b-90aa-4cb7-910e-e8270801bbcd tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] [instance: e28e570d-3d50-4fe8-bb4a-fe0e95c20fb7] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:54:29.048655 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-8024a88b-90aa-4cb7-910e-e8270801bbcd tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:29.049095 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-8024a88b-90aa-4cb7-910e-e8270801bbcd tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:29.050313 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-8024a88b-90aa-4cb7-910e-e8270801bbcd tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:29.050735 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-8024a88b-90aa-4cb7-910e-e8270801bbcd tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:29.099981 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-dd3f2c3f-66a4-4004-8415-300c1e116b4a tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:54:29.100627 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-dd3f2c3f-66a4-4004-8415-300c1e116b4a tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] [instance: d0080e4b-6532-4e0c-8d19-cfbdf32e401b] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:54:29.110678 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-dd3f2c3f-66a4-4004-8415-300c1e116b4a tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:29.111067 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-dd3f2c3f-66a4-4004-8415-300c1e116b4a tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:29.123692 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-dd3f2c3f-66a4-4004-8415-300c1e116b4a tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:29.124329 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-dd3f2c3f-66a4-4004-8415-300c1e116b4a tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:29.244087 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-8024a88b-90aa-4cb7-910e-e8270801bbcd tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:54:29.261424 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-8024a88b-90aa-4cb7-910e-e8270801bbcd tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:54:29.265945 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-8024a88b-90aa-4cb7-910e-e8270801bbcd tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:54:29.267362 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-8024a88b-90aa-4cb7-910e-e8270801bbcd tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] 10.222.0.26 "GET /compute/v2.1/servers/e28e570d-3d50-4fe8-bb4a-fe0e95c20fb7" status: 200 len: 1739 microversion: 2.20 time: 0.230457 Mar 05 02:54:29.278681 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 149/288] 10.222.0.26 () {60 vars in 1276 bytes} [Sat Mar 5 02:54:29 2022] GET /compute/v2.1/servers/e28e570d-3d50-4fe8-bb4a-fe0e95c20fb7 => generated 1739 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 02:54:29.319822 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-dd3f2c3f-66a4-4004-8415-300c1e116b4a tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e5a000087fe40419ccd0d1a96fb4783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9d27da2e71d4962a53a95efc46518ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:54:29.328325 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-dd3f2c3f-66a4-4004-8415-300c1e116b4a tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] 10.222.0.26 "GET /compute/v2.1/servers/d0080e4b-6532-4e0c-8d19-cfbdf32e401b" status: 200 len: 1724 microversion: 2.1 time: 0.232197 Mar 05 02:54:29.331779 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 140/289] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:54:29 2022] GET /compute/v2.1/servers/d0080e4b-6532-4e0c-8d19-cfbdf32e401b => generated 1724 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 02:54:29.539621 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-25ab8396-eae5-428b-a2db-d70b4d99f6dc tempest-VolumesSnapshotTestJSON-729970751 tempest-VolumesSnapshotTestJSON-729970751-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:54:29.540731 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-25ab8396-eae5-428b-a2db-d70b4d99f6dc tempest-VolumesSnapshotTestJSON-729970751 tempest-VolumesSnapshotTestJSON-729970751-project] [instance: b89e62f7-7ccc-48a6-ad76-88f6e022fe95] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:54:29.564044 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-25ab8396-eae5-428b-a2db-d70b4d99f6dc tempest-VolumesSnapshotTestJSON-729970751 tempest-VolumesSnapshotTestJSON-729970751-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:29.564492 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-25ab8396-eae5-428b-a2db-d70b4d99f6dc tempest-VolumesSnapshotTestJSON-729970751 tempest-VolumesSnapshotTestJSON-729970751-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:29.565318 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-25ab8396-eae5-428b-a2db-d70b4d99f6dc tempest-VolumesSnapshotTestJSON-729970751 tempest-VolumesSnapshotTestJSON-729970751-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:29.565752 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-25ab8396-eae5-428b-a2db-d70b4d99f6dc tempest-VolumesSnapshotTestJSON-729970751 tempest-VolumesSnapshotTestJSON-729970751-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:29.628806 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-dc33048a-2dc6-48d6-996d-ba2a78de80e7 tempest-VolumesNegativeTest-1423831724 tempest-VolumesNegativeTest-1423831724-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:54:29.629782 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-dc33048a-2dc6-48d6-996d-ba2a78de80e7 tempest-VolumesNegativeTest-1423831724 tempest-VolumesNegativeTest-1423831724-project] [instance: a8a27b43-73c6-4d5a-87ee-888eda8d677b] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:54:29.637600 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-dc33048a-2dc6-48d6-996d-ba2a78de80e7 tempest-VolumesNegativeTest-1423831724 tempest-VolumesNegativeTest-1423831724-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:29.638335 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-dc33048a-2dc6-48d6-996d-ba2a78de80e7 tempest-VolumesNegativeTest-1423831724 tempest-VolumesNegativeTest-1423831724-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:29.640617 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-dc33048a-2dc6-48d6-996d-ba2a78de80e7 tempest-VolumesNegativeTest-1423831724 tempest-VolumesNegativeTest-1423831724-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:29.641056 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-dc33048a-2dc6-48d6-996d-ba2a78de80e7 tempest-VolumesNegativeTest-1423831724 tempest-VolumesNegativeTest-1423831724-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:29.793087 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-25ab8396-eae5-428b-a2db-d70b4d99f6dc tempest-VolumesSnapshotTestJSON-729970751 tempest-VolumesSnapshotTestJSON-729970751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84de0440c1444309d9c9b6c706bae73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8efa5f5dbc9f460aa91f4f62eb57abee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:54:29.808998 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-25ab8396-eae5-428b-a2db-d70b4d99f6dc tempest-VolumesSnapshotTestJSON-729970751 tempest-VolumesSnapshotTestJSON-729970751-project] 10.222.0.26 "GET /compute/v2.1/servers/b89e62f7-7ccc-48a6-ad76-88f6e022fe95" status: 200 len: 1318 microversion: 2.1 time: 0.266338 Mar 05 02:54:29.815607 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 150/290] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:54:29 2022] GET /compute/v2.1/servers/b89e62f7-7ccc-48a6-ad76-88f6e022fe95 => generated 1318 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 02:54:29.837547 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-acb61b5a-6ace-4fb4-98c3-b8fa5c74bb94 tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:54:29.838195 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-acb61b5a-6ace-4fb4-98c3-b8fa5c74bb94 tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] [instance: d73f2b8e-9af1-4395-9995-f34cd8187681] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:54:29.845419 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-acb61b5a-6ace-4fb4-98c3-b8fa5c74bb94 tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:29.846131 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-acb61b5a-6ace-4fb4-98c3-b8fa5c74bb94 tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:29.847247 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-acb61b5a-6ace-4fb4-98c3-b8fa5c74bb94 tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:29.847865 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-acb61b5a-6ace-4fb4-98c3-b8fa5c74bb94 tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:29.931289 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-dc33048a-2dc6-48d6-996d-ba2a78de80e7 tempest-VolumesNegativeTest-1423831724 tempest-VolumesNegativeTest-1423831724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2097ae8dee5b4d17a4f4921393c3e70f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6d0875d975e453cab8434d214003ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:54:29.952670 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-dc33048a-2dc6-48d6-996d-ba2a78de80e7 tempest-VolumesNegativeTest-1423831724 tempest-VolumesNegativeTest-1423831724-project] 10.222.0.26 "GET /compute/v2.1/servers/a8a27b43-73c6-4d5a-87ee-888eda8d677b" status: 200 len: 1314 microversion: 2.1 time: 0.331694 Mar 05 02:54:29.963086 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 141/291] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:54:29 2022] GET /compute/v2.1/servers/a8a27b43-73c6-4d5a-87ee-888eda8d677b => generated 1314 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 02:54:29.963086 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-96bac408-5012-4dd0-b904-89f293e5c2e0 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 02:54:29.963086 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-96bac408-5012-4dd0-b904-89f293e5c2e0 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] [instance: c24fee69-5bf4-40f4-ba18-56aecd12dd96] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:54:29.971148 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-96bac408-5012-4dd0-b904-89f293e5c2e0 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:29.971719 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-96bac408-5012-4dd0-b904-89f293e5c2e0 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:29.972597 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-96bac408-5012-4dd0-b904-89f293e5c2e0 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:29.973137 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-96bac408-5012-4dd0-b904-89f293e5c2e0 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:30.010039 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.objects.instance [None req-96bac408-5012-4dd0-b904-89f293e5c2e0 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lazy-loading 'flavor' on Instance uuid c24fee69-5bf4-40f4-ba18-56aecd12dd96 {{(pid=123546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 05 02:54:30.079620 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-acb61b5a-6ace-4fb4-98c3-b8fa5c74bb94 tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1700aa8052b94f878886b08f94f05831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3afb5b14217e4a54ab03e6233f8aaa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:54:30.097428 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-acb61b5a-6ace-4fb4-98c3-b8fa5c74bb94 tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] 10.222.0.26 "GET /compute/v2.1/servers/d73f2b8e-9af1-4395-9995-f34cd8187681" status: 200 len: 1313 microversion: 2.1 time: 0.274115 Mar 05 02:54:30.098142 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 151/292] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:54:29 2022] GET /compute/v2.1/servers/d73f2b8e-9af1-4395-9995-f34cd8187681 => generated 1313 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 02:54:30.242642 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-96bac408-5012-4dd0-b904-89f293e5c2e0 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] 10.222.0.26 "POST /compute/v2.1/servers/c24fee69-5bf4-40f4-ba18-56aecd12dd96/action" status: 200 len: 32 microversion: 2.1 time: 0.285752 Mar 05 02:54:30.243400 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 142/293] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Mar 5 02:54:29 2022] POST /compute/v2.1/servers/c24fee69-5bf4-40f4-ba18-56aecd12dd96/action => generated 32 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 05 02:54:30.260056 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-914dd56d-aa62-417e-ab13-1dd25cf1b664 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:54:30.261569 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-914dd56d-aa62-417e-ab13-1dd25cf1b664 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] [instance: c24fee69-5bf4-40f4-ba18-56aecd12dd96] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:54:30.269791 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-914dd56d-aa62-417e-ab13-1dd25cf1b664 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:30.270534 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-914dd56d-aa62-417e-ab13-1dd25cf1b664 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:30.271351 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-914dd56d-aa62-417e-ab13-1dd25cf1b664 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:30.271793 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-914dd56d-aa62-417e-ab13-1dd25cf1b664 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:30.289529 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-7a971858-b245-42c8-be12-ad29ce79f255 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:54:30.290971 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-7a971858-b245-42c8-be12-ad29ce79f255 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] [instance: e28e570d-3d50-4fe8-bb4a-fe0e95c20fb7] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:54:30.312431 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-7a971858-b245-42c8-be12-ad29ce79f255 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:30.313376 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-7a971858-b245-42c8-be12-ad29ce79f255 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:30.314422 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-7a971858-b245-42c8-be12-ad29ce79f255 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:30.315134 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-7a971858-b245-42c8-be12-ad29ce79f255 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:30.600507 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-914dd56d-aa62-417e-ab13-1dd25cf1b664 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90033e5e8e634b699bf050e36519f8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8112a5759c444c1f94be24ab61bf072f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:54:30.611542 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-914dd56d-aa62-417e-ab13-1dd25cf1b664 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] 10.222.0.26 "GET /compute/v2.1/servers/c24fee69-5bf4-40f4-ba18-56aecd12dd96" status: 200 len: 1566 microversion: 2.1 time: 0.362283 Mar 05 02:54:30.612690 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 152/294] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:54:30 2022] GET /compute/v2.1/servers/c24fee69-5bf4-40f4-ba18-56aecd12dd96 => generated 1566 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 02:54:30.621543 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-2e40ad61-718f-473e-88ad-5a0fc1434870 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:54:30.622477 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-2e40ad61-718f-473e-88ad-5a0fc1434870 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] [instance: d0080e4b-6532-4e0c-8d19-cfbdf32e401b] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:54:30.632805 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-7a971858-b245-42c8-be12-ad29ce79f255 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:54:30.636540 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-2e40ad61-718f-473e-88ad-5a0fc1434870 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:30.639745 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-2e40ad61-718f-473e-88ad-5a0fc1434870 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:30.642423 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-7a971858-b245-42c8-be12-ad29ce79f255 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:54:30.643408 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-2e40ad61-718f-473e-88ad-5a0fc1434870 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:30.643856 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-2e40ad61-718f-473e-88ad-5a0fc1434870 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:30.643985 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-7a971858-b245-42c8-be12-ad29ce79f255 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:54:30.645090 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-7a971858-b245-42c8-be12-ad29ce79f255 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] 10.222.0.26 "GET /compute/v2.1/servers/e28e570d-3d50-4fe8-bb4a-fe0e95c20fb7" status: 200 len: 1739 microversion: 2.20 time: 0.363167 Mar 05 02:54:30.653826 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 143/295] 10.222.0.26 () {60 vars in 1276 bytes} [Sat Mar 5 02:54:30 2022] GET /compute/v2.1/servers/e28e570d-3d50-4fe8-bb4a-fe0e95c20fb7 => generated 1739 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 02:54:30.820700 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-4f433dd3-1a75-4347-9d81-991ecc8656b4 tempest-VolumesSnapshotTestJSON-729970751 tempest-VolumesSnapshotTestJSON-729970751-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:54:30.826887 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-4f433dd3-1a75-4347-9d81-991ecc8656b4 tempest-VolumesSnapshotTestJSON-729970751 tempest-VolumesSnapshotTestJSON-729970751-project] [instance: b89e62f7-7ccc-48a6-ad76-88f6e022fe95] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:54:30.860377 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-4f433dd3-1a75-4347-9d81-991ecc8656b4 tempest-VolumesSnapshotTestJSON-729970751 tempest-VolumesSnapshotTestJSON-729970751-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:30.861184 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-4f433dd3-1a75-4347-9d81-991ecc8656b4 tempest-VolumesSnapshotTestJSON-729970751 tempest-VolumesSnapshotTestJSON-729970751-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:30.862179 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-4f433dd3-1a75-4347-9d81-991ecc8656b4 tempest-VolumesSnapshotTestJSON-729970751 tempest-VolumesSnapshotTestJSON-729970751-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:30.862813 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-4f433dd3-1a75-4347-9d81-991ecc8656b4 tempest-VolumesSnapshotTestJSON-729970751 tempest-VolumesSnapshotTestJSON-729970751-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:30.987147 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-2e40ad61-718f-473e-88ad-5a0fc1434870 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e5a000087fe40419ccd0d1a96fb4783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9d27da2e71d4962a53a95efc46518ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:54:30.995655 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-2e40ad61-718f-473e-88ad-5a0fc1434870 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] 10.222.0.26 "GET /compute/v2.1/servers/d0080e4b-6532-4e0c-8d19-cfbdf32e401b" status: 200 len: 1724 microversion: 2.1 time: 0.381754 Mar 05 02:54:31.002046 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 153/296] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:54:30 2022] GET /compute/v2.1/servers/d0080e4b-6532-4e0c-8d19-cfbdf32e401b => generated 1724 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 02:54:31.007279 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-5c3b5dd6-8575-4e2f-b1ad-e30dabb75e75 tempest-VolumesNegativeTest-1423831724 tempest-VolumesNegativeTest-1423831724-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:54:31.007966 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-5c3b5dd6-8575-4e2f-b1ad-e30dabb75e75 tempest-VolumesNegativeTest-1423831724 tempest-VolumesNegativeTest-1423831724-project] [instance: a8a27b43-73c6-4d5a-87ee-888eda8d677b] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:54:31.018367 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-5c3b5dd6-8575-4e2f-b1ad-e30dabb75e75 tempest-VolumesNegativeTest-1423831724 tempest-VolumesNegativeTest-1423831724-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:31.019038 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-5c3b5dd6-8575-4e2f-b1ad-e30dabb75e75 tempest-VolumesNegativeTest-1423831724 tempest-VolumesNegativeTest-1423831724-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:31.022406 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-5c3b5dd6-8575-4e2f-b1ad-e30dabb75e75 tempest-VolumesNegativeTest-1423831724 tempest-VolumesNegativeTest-1423831724-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:31.023214 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-5c3b5dd6-8575-4e2f-b1ad-e30dabb75e75 tempest-VolumesNegativeTest-1423831724 tempest-VolumesNegativeTest-1423831724-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:31.329422 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-4f433dd3-1a75-4347-9d81-991ecc8656b4 tempest-VolumesSnapshotTestJSON-729970751 tempest-VolumesSnapshotTestJSON-729970751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84de0440c1444309d9c9b6c706bae73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8efa5f5dbc9f460aa91f4f62eb57abee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:54:31.337169 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-4f433dd3-1a75-4347-9d81-991ecc8656b4 tempest-VolumesSnapshotTestJSON-729970751 tempest-VolumesSnapshotTestJSON-729970751-project] 10.222.0.26 "GET /compute/v2.1/servers/b89e62f7-7ccc-48a6-ad76-88f6e022fe95" status: 200 len: 1318 microversion: 2.1 time: 0.520423 Mar 05 02:54:31.338281 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 144/297] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:54:30 2022] GET /compute/v2.1/servers/b89e62f7-7ccc-48a6-ad76-88f6e022fe95 => generated 1318 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 02:54:31.343690 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [req-8c229264-8893-4a86-85ef-d3583cf07066 req-09b7be06-584e-4c82-b5e5-90835263cfba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b89e62f7-7ccc-48a6-ad76-88f6e022fe95", "name": "network-vif-plugged", "status": "completed", "tag": "1165b4f9-8e23-488c-bf07-4804d1f8bb98"}]} {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 02:54:31.352307 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [req-8c229264-8893-4a86-85ef-d3583cf07066 req-09b7be06-584e-4c82-b5e5-90835263cfba service nova] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:31.353104 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [req-8c229264-8893-4a86-85ef-d3583cf07066 req-09b7be06-584e-4c82-b5e5-90835263cfba service nova] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:31.359589 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-5c3b5dd6-8575-4e2f-b1ad-e30dabb75e75 tempest-VolumesNegativeTest-1423831724 tempest-VolumesNegativeTest-1423831724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2097ae8dee5b4d17a4f4921393c3e70f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6d0875d975e453cab8434d214003ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:54:31.387657 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.compute.server_external_events [req-8c229264-8893-4a86-85ef-d3583cf07066 req-09b7be06-584e-4c82-b5e5-90835263cfba service nova] Creating event network-vif-plugged:1165b4f9-8e23-488c-bf07-4804d1f8bb98 for instance b89e62f7-7ccc-48a6-ad76-88f6e022fe95 on hv-cinder-82725 Mar 05 02:54:31.388797 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-5c3b5dd6-8575-4e2f-b1ad-e30dabb75e75 tempest-VolumesNegativeTest-1423831724 tempest-VolumesNegativeTest-1423831724-project] 10.222.0.26 "GET /compute/v2.1/servers/a8a27b43-73c6-4d5a-87ee-888eda8d677b" status: 200 len: 1314 microversion: 2.1 time: 0.374896 Mar 05 02:54:31.399061 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 154/298] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:54:31 2022] GET /compute/v2.1/servers/a8a27b43-73c6-4d5a-87ee-888eda8d677b => generated 1314 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 02:54:31.399061 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-19a096b0-8b58-4b36-a656-eae003f6d232 tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:54:31.399061 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-19a096b0-8b58-4b36-a656-eae003f6d232 tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] [instance: d73f2b8e-9af1-4395-9995-f34cd8187681] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:54:31.407655 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [req-8c229264-8893-4a86-85ef-d3583cf07066 req-09b7be06-584e-4c82-b5e5-90835263cfba service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067707 Mar 05 02:54:31.412632 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 145/299] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Mar 5 02:54:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 02:54:31.414307 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-19a096b0-8b58-4b36-a656-eae003f6d232 tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:31.414994 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-19a096b0-8b58-4b36-a656-eae003f6d232 tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:31.415852 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-19a096b0-8b58-4b36-a656-eae003f6d232 tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:31.417009 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-19a096b0-8b58-4b36-a656-eae003f6d232 tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:31.619860 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-19a096b0-8b58-4b36-a656-eae003f6d232 tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1700aa8052b94f878886b08f94f05831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3afb5b14217e4a54ab03e6233f8aaa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:54:31.637306 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-1139e4c0-cdb0-40bb-949f-6f662486c59f tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:54:31.642739 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-1139e4c0-cdb0-40bb-949f-6f662486c59f tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] [instance: c24fee69-5bf4-40f4-ba18-56aecd12dd96] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:54:31.647375 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-19a096b0-8b58-4b36-a656-eae003f6d232 tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] 10.222.0.26 "GET /compute/v2.1/servers/d73f2b8e-9af1-4395-9995-f34cd8187681" status: 200 len: 1313 microversion: 2.1 time: 0.256669 Mar 05 02:54:31.651500 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 155/300] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:54:31 2022] GET /compute/v2.1/servers/d73f2b8e-9af1-4395-9995-f34cd8187681 => generated 1313 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 02:54:31.674979 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-1139e4c0-cdb0-40bb-949f-6f662486c59f tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:31.675457 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-1139e4c0-cdb0-40bb-949f-6f662486c59f tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:31.676428 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-1139e4c0-cdb0-40bb-949f-6f662486c59f tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:31.677019 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-1139e4c0-cdb0-40bb-949f-6f662486c59f tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:31.684794 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-8b21aaca-bb6e-42e1-a9a2-3e93cc5417bc tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:54:31.690344 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-8b21aaca-bb6e-42e1-a9a2-3e93cc5417bc tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] [instance: e28e570d-3d50-4fe8-bb4a-fe0e95c20fb7] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:54:31.710636 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-8b21aaca-bb6e-42e1-a9a2-3e93cc5417bc tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:31.713545 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-8b21aaca-bb6e-42e1-a9a2-3e93cc5417bc tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:31.719492 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-8b21aaca-bb6e-42e1-a9a2-3e93cc5417bc tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:31.720107 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-8b21aaca-bb6e-42e1-a9a2-3e93cc5417bc tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:32.027337 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-1139e4c0-cdb0-40bb-949f-6f662486c59f tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90033e5e8e634b699bf050e36519f8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8112a5759c444c1f94be24ab61bf072f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:54:32.038809 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-1139e4c0-cdb0-40bb-949f-6f662486c59f tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] 10.222.0.26 "GET /compute/v2.1/servers/c24fee69-5bf4-40f4-ba18-56aecd12dd96" status: 200 len: 1566 microversion: 2.1 time: 0.410851 Mar 05 02:54:32.039815 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 146/301] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:54:31 2022] GET /compute/v2.1/servers/c24fee69-5bf4-40f4-ba18-56aecd12dd96 => generated 1566 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 02:54:32.048508 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-482f678e-aa24-41a9-9c05-60ab9f4bf7e4 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:54:32.049166 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-482f678e-aa24-41a9-9c05-60ab9f4bf7e4 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] [instance: d0080e4b-6532-4e0c-8d19-cfbdf32e401b] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:54:32.068404 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-482f678e-aa24-41a9-9c05-60ab9f4bf7e4 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:32.071836 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-482f678e-aa24-41a9-9c05-60ab9f4bf7e4 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:32.073632 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-482f678e-aa24-41a9-9c05-60ab9f4bf7e4 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:32.074156 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-482f678e-aa24-41a9-9c05-60ab9f4bf7e4 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:32.084739 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-8b21aaca-bb6e-42e1-a9a2-3e93cc5417bc tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:54:32.093529 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-8b21aaca-bb6e-42e1-a9a2-3e93cc5417bc tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:54:32.095145 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-8b21aaca-bb6e-42e1-a9a2-3e93cc5417bc tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:54:32.096374 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-8b21aaca-bb6e-42e1-a9a2-3e93cc5417bc tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] 10.222.0.26 "GET /compute/v2.1/servers/e28e570d-3d50-4fe8-bb4a-fe0e95c20fb7" status: 200 len: 1739 microversion: 2.20 time: 0.428469 Mar 05 02:54:32.097161 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 156/302] 10.222.0.26 () {60 vars in 1276 bytes} [Sat Mar 5 02:54:31 2022] GET /compute/v2.1/servers/e28e570d-3d50-4fe8-bb4a-fe0e95c20fb7 => generated 1739 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 02:54:32.234487 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-482f678e-aa24-41a9-9c05-60ab9f4bf7e4 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e5a000087fe40419ccd0d1a96fb4783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9d27da2e71d4962a53a95efc46518ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:54:32.243103 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-482f678e-aa24-41a9-9c05-60ab9f4bf7e4 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] 10.222.0.26 "GET /compute/v2.1/servers/d0080e4b-6532-4e0c-8d19-cfbdf32e401b" status: 200 len: 1724 microversion: 2.1 time: 0.202070 Mar 05 02:54:32.243684 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 147/303] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:54:32 2022] GET /compute/v2.1/servers/d0080e4b-6532-4e0c-8d19-cfbdf32e401b => generated 1724 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 02:54:32.357945 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-3df3cc99-3f3e-46e0-92a6-7e6ec8f9e5ef tempest-VolumesSnapshotTestJSON-729970751 tempest-VolumesSnapshotTestJSON-729970751-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:54:32.358728 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-3df3cc99-3f3e-46e0-92a6-7e6ec8f9e5ef tempest-VolumesSnapshotTestJSON-729970751 tempest-VolumesSnapshotTestJSON-729970751-project] [instance: b89e62f7-7ccc-48a6-ad76-88f6e022fe95] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:54:32.364893 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-3df3cc99-3f3e-46e0-92a6-7e6ec8f9e5ef tempest-VolumesSnapshotTestJSON-729970751 tempest-VolumesSnapshotTestJSON-729970751-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:32.365518 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-3df3cc99-3f3e-46e0-92a6-7e6ec8f9e5ef tempest-VolumesSnapshotTestJSON-729970751 tempest-VolumesSnapshotTestJSON-729970751-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:32.366129 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-3df3cc99-3f3e-46e0-92a6-7e6ec8f9e5ef tempest-VolumesSnapshotTestJSON-729970751 tempest-VolumesSnapshotTestJSON-729970751-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:32.366727 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-3df3cc99-3f3e-46e0-92a6-7e6ec8f9e5ef tempest-VolumesSnapshotTestJSON-729970751 tempest-VolumesSnapshotTestJSON-729970751-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:32.412686 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-50c5f7e6-a4ab-4551-9b07-b7dc647d38b5 tempest-VolumesNegativeTest-1423831724 tempest-VolumesNegativeTest-1423831724-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:54:32.414136 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-50c5f7e6-a4ab-4551-9b07-b7dc647d38b5 tempest-VolumesNegativeTest-1423831724 tempest-VolumesNegativeTest-1423831724-project] [instance: a8a27b43-73c6-4d5a-87ee-888eda8d677b] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:54:32.424214 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-50c5f7e6-a4ab-4551-9b07-b7dc647d38b5 tempest-VolumesNegativeTest-1423831724 tempest-VolumesNegativeTest-1423831724-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:32.424762 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-50c5f7e6-a4ab-4551-9b07-b7dc647d38b5 tempest-VolumesNegativeTest-1423831724 tempest-VolumesNegativeTest-1423831724-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:32.426148 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-50c5f7e6-a4ab-4551-9b07-b7dc647d38b5 tempest-VolumesNegativeTest-1423831724 tempest-VolumesNegativeTest-1423831724-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:32.426787 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-50c5f7e6-a4ab-4551-9b07-b7dc647d38b5 tempest-VolumesNegativeTest-1423831724 tempest-VolumesNegativeTest-1423831724-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:32.573116 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-3df3cc99-3f3e-46e0-92a6-7e6ec8f9e5ef tempest-VolumesSnapshotTestJSON-729970751 tempest-VolumesSnapshotTestJSON-729970751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84de0440c1444309d9c9b6c706bae73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8efa5f5dbc9f460aa91f4f62eb57abee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:54:32.581871 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-3df3cc99-3f3e-46e0-92a6-7e6ec8f9e5ef tempest-VolumesSnapshotTestJSON-729970751 tempest-VolumesSnapshotTestJSON-729970751-project] 10.222.0.26 "GET /compute/v2.1/servers/b89e62f7-7ccc-48a6-ad76-88f6e022fe95" status: 200 len: 1318 microversion: 2.1 time: 0.230128 Mar 05 02:54:32.583930 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 157/304] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:54:32 2022] GET /compute/v2.1/servers/b89e62f7-7ccc-48a6-ad76-88f6e022fe95 => generated 1318 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 02:54:32.666506 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-50c5f7e6-a4ab-4551-9b07-b7dc647d38b5 tempest-VolumesNegativeTest-1423831724 tempest-VolumesNegativeTest-1423831724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2097ae8dee5b4d17a4f4921393c3e70f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6d0875d975e453cab8434d214003ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:54:32.668743 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-f2b3f3ad-df41-462c-8c30-98338255f677 tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:54:32.669459 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-f2b3f3ad-df41-462c-8c30-98338255f677 tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] [instance: d73f2b8e-9af1-4395-9995-f34cd8187681] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:54:32.689326 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-f2b3f3ad-df41-462c-8c30-98338255f677 tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:32.690000 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-f2b3f3ad-df41-462c-8c30-98338255f677 tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:32.691102 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-f2b3f3ad-df41-462c-8c30-98338255f677 tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:32.691668 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-f2b3f3ad-df41-462c-8c30-98338255f677 tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:32.692579 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-50c5f7e6-a4ab-4551-9b07-b7dc647d38b5 tempest-VolumesNegativeTest-1423831724 tempest-VolumesNegativeTest-1423831724-project] 10.222.0.26 "GET /compute/v2.1/servers/a8a27b43-73c6-4d5a-87ee-888eda8d677b" status: 200 len: 1314 microversion: 2.1 time: 0.289902 Mar 05 02:54:32.693174 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 148/305] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:54:32 2022] GET /compute/v2.1/servers/a8a27b43-73c6-4d5a-87ee-888eda8d677b => generated 1314 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 02:54:32.870315 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-f2b3f3ad-df41-462c-8c30-98338255f677 tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1700aa8052b94f878886b08f94f05831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3afb5b14217e4a54ab03e6233f8aaa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:54:32.883451 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-f2b3f3ad-df41-462c-8c30-98338255f677 tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] 10.222.0.26 "GET /compute/v2.1/servers/d73f2b8e-9af1-4395-9995-f34cd8187681" status: 200 len: 1313 microversion: 2.1 time: 0.218570 Mar 05 02:54:32.884608 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 158/306] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:54:32 2022] GET /compute/v2.1/servers/d73f2b8e-9af1-4395-9995-f34cd8187681 => generated 1313 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 02:54:33.056548 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-9bb0a3da-226d-454f-895b-fe2801adcea2 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:54:33.057206 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-9bb0a3da-226d-454f-895b-fe2801adcea2 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] [instance: c24fee69-5bf4-40f4-ba18-56aecd12dd96] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:54:33.065127 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-9bb0a3da-226d-454f-895b-fe2801adcea2 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:33.065631 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-9bb0a3da-226d-454f-895b-fe2801adcea2 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:33.066566 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-9bb0a3da-226d-454f-895b-fe2801adcea2 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:33.067012 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-9bb0a3da-226d-454f-895b-fe2801adcea2 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:33.116850 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-2b0d56ca-5255-4d56-a19b-ae0d6d878ac4 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:54:33.117597 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-2b0d56ca-5255-4d56-a19b-ae0d6d878ac4 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] [instance: e28e570d-3d50-4fe8-bb4a-fe0e95c20fb7] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:54:33.125093 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-2b0d56ca-5255-4d56-a19b-ae0d6d878ac4 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:33.125539 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-2b0d56ca-5255-4d56-a19b-ae0d6d878ac4 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:33.126333 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-2b0d56ca-5255-4d56-a19b-ae0d6d878ac4 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:33.126768 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-2b0d56ca-5255-4d56-a19b-ae0d6d878ac4 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:33.245730 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-9bb0a3da-226d-454f-895b-fe2801adcea2 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90033e5e8e634b699bf050e36519f8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8112a5759c444c1f94be24ab61bf072f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:54:33.254417 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-9bb0a3da-226d-454f-895b-fe2801adcea2 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] 10.222.0.26 "GET /compute/v2.1/servers/c24fee69-5bf4-40f4-ba18-56aecd12dd96" status: 200 len: 1566 microversion: 2.1 time: 0.201596 Mar 05 02:54:33.264518 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 149/307] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:54:33 2022] GET /compute/v2.1/servers/c24fee69-5bf4-40f4-ba18-56aecd12dd96 => generated 1566 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 02:54:33.264518 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-20e4ac82-0ac8-4094-a2f2-c45c93b8db29 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:54:33.264518 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-20e4ac82-0ac8-4094-a2f2-c45c93b8db29 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] [instance: d0080e4b-6532-4e0c-8d19-cfbdf32e401b] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:54:33.271241 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-20e4ac82-0ac8-4094-a2f2-c45c93b8db29 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:33.271906 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-20e4ac82-0ac8-4094-a2f2-c45c93b8db29 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:33.272746 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-20e4ac82-0ac8-4094-a2f2-c45c93b8db29 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:33.273180 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-20e4ac82-0ac8-4094-a2f2-c45c93b8db29 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:33.308948 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-2b0d56ca-5255-4d56-a19b-ae0d6d878ac4 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:54:33.317481 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-2b0d56ca-5255-4d56-a19b-ae0d6d878ac4 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:54:33.319018 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-2b0d56ca-5255-4d56-a19b-ae0d6d878ac4 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:54:33.320169 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-2b0d56ca-5255-4d56-a19b-ae0d6d878ac4 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] 10.222.0.26 "GET /compute/v2.1/servers/e28e570d-3d50-4fe8-bb4a-fe0e95c20fb7" status: 200 len: 1739 microversion: 2.20 time: 0.207390 Mar 05 02:54:33.320723 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 159/308] 10.222.0.26 () {60 vars in 1276 bytes} [Sat Mar 5 02:54:33 2022] GET /compute/v2.1/servers/e28e570d-3d50-4fe8-bb4a-fe0e95c20fb7 => generated 1739 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 05 02:54:33.409215 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-20e4ac82-0ac8-4094-a2f2-c45c93b8db29 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e5a000087fe40419ccd0d1a96fb4783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9d27da2e71d4962a53a95efc46518ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:54:33.417647 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-20e4ac82-0ac8-4094-a2f2-c45c93b8db29 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] 10.222.0.26 "GET /compute/v2.1/servers/d0080e4b-6532-4e0c-8d19-cfbdf32e401b" status: 200 len: 1724 microversion: 2.1 time: 0.158872 Mar 05 02:54:33.418230 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 150/309] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:54:33 2022] GET /compute/v2.1/servers/d0080e4b-6532-4e0c-8d19-cfbdf32e401b => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 02:54:33.423109 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [req-579f85d9-38f0-4910-8558-4c935c851d1c req-785f1a86-0575-45b9-b6ee-b05b1d772deb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d73f2b8e-9af1-4395-9995-f34cd8187681", "name": "network-vif-plugged", "status": "completed", "tag": "63cfcfd4-050a-4cef-9d98-a1860af5f5ca"}, {"server_uuid": "a8a27b43-73c6-4d5a-87ee-888eda8d677b", "name": "network-vif-plugged", "status": "completed", "tag": "67df0ed3-4a7f-4353-a18d-274a902ce784"}]} {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 02:54:33.432030 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [req-579f85d9-38f0-4910-8558-4c935c851d1c req-785f1a86-0575-45b9-b6ee-b05b1d772deb service nova] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:33.432478 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [req-579f85d9-38f0-4910-8558-4c935c851d1c req-785f1a86-0575-45b9-b6ee-b05b1d772deb service nova] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:33.444973 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.compute.server_external_events [req-579f85d9-38f0-4910-8558-4c935c851d1c req-785f1a86-0575-45b9-b6ee-b05b1d772deb service nova] Creating event network-vif-plugged:63cfcfd4-050a-4cef-9d98-a1860af5f5ca for instance d73f2b8e-9af1-4395-9995-f34cd8187681 on hv-cinder-82725 Mar 05 02:54:33.445500 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.compute.server_external_events [req-579f85d9-38f0-4910-8558-4c935c851d1c req-785f1a86-0575-45b9-b6ee-b05b1d772deb service nova] Creating event network-vif-plugged:67df0ed3-4a7f-4353-a18d-274a902ce784 for instance a8a27b43-73c6-4d5a-87ee-888eda8d677b on hv-cinder-82725 Mar 05 02:54:33.452070 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [req-579f85d9-38f0-4910-8558-4c935c851d1c req-785f1a86-0575-45b9-b6ee-b05b1d772deb service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.033121 Mar 05 02:54:33.452665 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 160/310] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Mar 5 02:54:33 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 02:54:33.601933 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-7aa1484c-eebc-4167-9ef1-e58ac459f8ae tempest-VolumesSnapshotTestJSON-729970751 tempest-VolumesSnapshotTestJSON-729970751-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:54:33.602481 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-7aa1484c-eebc-4167-9ef1-e58ac459f8ae tempest-VolumesSnapshotTestJSON-729970751 tempest-VolumesSnapshotTestJSON-729970751-project] [instance: b89e62f7-7ccc-48a6-ad76-88f6e022fe95] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:54:33.608699 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-7aa1484c-eebc-4167-9ef1-e58ac459f8ae tempest-VolumesSnapshotTestJSON-729970751 tempest-VolumesSnapshotTestJSON-729970751-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:33.609143 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-7aa1484c-eebc-4167-9ef1-e58ac459f8ae tempest-VolumesSnapshotTestJSON-729970751 tempest-VolumesSnapshotTestJSON-729970751-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:33.610005 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-7aa1484c-eebc-4167-9ef1-e58ac459f8ae tempest-VolumesSnapshotTestJSON-729970751 tempest-VolumesSnapshotTestJSON-729970751-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:33.610438 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-7aa1484c-eebc-4167-9ef1-e58ac459f8ae tempest-VolumesSnapshotTestJSON-729970751 tempest-VolumesSnapshotTestJSON-729970751-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:33.711561 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-68504314-fdb5-40f2-bc2b-27a5b3c30387 tempest-VolumesNegativeTest-1423831724 tempest-VolumesNegativeTest-1423831724-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:54:33.712522 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-68504314-fdb5-40f2-bc2b-27a5b3c30387 tempest-VolumesNegativeTest-1423831724 tempest-VolumesNegativeTest-1423831724-project] [instance: a8a27b43-73c6-4d5a-87ee-888eda8d677b] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:54:33.719591 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-68504314-fdb5-40f2-bc2b-27a5b3c30387 tempest-VolumesNegativeTest-1423831724 tempest-VolumesNegativeTest-1423831724-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:33.720309 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-68504314-fdb5-40f2-bc2b-27a5b3c30387 tempest-VolumesNegativeTest-1423831724 tempest-VolumesNegativeTest-1423831724-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:33.721318 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-68504314-fdb5-40f2-bc2b-27a5b3c30387 tempest-VolumesNegativeTest-1423831724 tempest-VolumesNegativeTest-1423831724-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:33.721874 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-68504314-fdb5-40f2-bc2b-27a5b3c30387 tempest-VolumesNegativeTest-1423831724 tempest-VolumesNegativeTest-1423831724-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:33.881080 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-7aa1484c-eebc-4167-9ef1-e58ac459f8ae tempest-VolumesSnapshotTestJSON-729970751 tempest-VolumesSnapshotTestJSON-729970751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84de0440c1444309d9c9b6c706bae73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8efa5f5dbc9f460aa91f4f62eb57abee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:54:33.889749 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-7aa1484c-eebc-4167-9ef1-e58ac459f8ae tempest-VolumesSnapshotTestJSON-729970751 tempest-VolumesSnapshotTestJSON-729970751-project] 10.222.0.26 "GET /compute/v2.1/servers/b89e62f7-7ccc-48a6-ad76-88f6e022fe95" status: 200 len: 1506 microversion: 2.1 time: 0.292100 Mar 05 02:54:33.890355 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 151/311] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:54:33 2022] GET /compute/v2.1/servers/b89e62f7-7ccc-48a6-ad76-88f6e022fe95 => generated 1506 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 02:54:33.900285 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-511e337a-93a5-46be-b602-c0685a9e37c5 tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:54:33.901032 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-511e337a-93a5-46be-b602-c0685a9e37c5 tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] [instance: d73f2b8e-9af1-4395-9995-f34cd8187681] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:54:33.908877 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-511e337a-93a5-46be-b602-c0685a9e37c5 tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:33.909417 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-511e337a-93a5-46be-b602-c0685a9e37c5 tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:33.910150 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-511e337a-93a5-46be-b602-c0685a9e37c5 tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:33.910592 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-511e337a-93a5-46be-b602-c0685a9e37c5 tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:33.992319 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-68504314-fdb5-40f2-bc2b-27a5b3c30387 tempest-VolumesNegativeTest-1423831724 tempest-VolumesNegativeTest-1423831724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2097ae8dee5b4d17a4f4921393c3e70f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6d0875d975e453cab8434d214003ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:54:34.002453 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-68504314-fdb5-40f2-bc2b-27a5b3c30387 tempest-VolumesNegativeTest-1423831724 tempest-VolumesNegativeTest-1423831724-project] 10.222.0.26 "GET /compute/v2.1/servers/a8a27b43-73c6-4d5a-87ee-888eda8d677b" status: 200 len: 1314 microversion: 2.1 time: 0.294406 Mar 05 02:54:34.011863 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 161/312] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:54:33 2022] GET /compute/v2.1/servers/a8a27b43-73c6-4d5a-87ee-888eda8d677b => generated 1314 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 02:54:34.067162 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-511e337a-93a5-46be-b602-c0685a9e37c5 tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1700aa8052b94f878886b08f94f05831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3afb5b14217e4a54ab03e6233f8aaa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:54:34.075167 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-511e337a-93a5-46be-b602-c0685a9e37c5 tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] 10.222.0.26 "GET /compute/v2.1/servers/d73f2b8e-9af1-4395-9995-f34cd8187681" status: 200 len: 1313 microversion: 2.1 time: 0.178475 Mar 05 02:54:34.075700 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 152/313] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:54:33 2022] GET /compute/v2.1/servers/d73f2b8e-9af1-4395-9995-f34cd8187681 => generated 1313 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 02:54:34.278109 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-4250443d-ec5d-42d3-bf7b-b13147bdaee5 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:54:34.280695 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-4250443d-ec5d-42d3-bf7b-b13147bdaee5 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] [instance: c24fee69-5bf4-40f4-ba18-56aecd12dd96] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:54:34.289656 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-4250443d-ec5d-42d3-bf7b-b13147bdaee5 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:34.290562 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-4250443d-ec5d-42d3-bf7b-b13147bdaee5 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:34.292340 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-4250443d-ec5d-42d3-bf7b-b13147bdaee5 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:34.293152 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-4250443d-ec5d-42d3-bf7b-b13147bdaee5 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:34.339708 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-689b3bd9-db7b-4a56-9abd-7c30cf5083ac tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:54:34.340541 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-689b3bd9-db7b-4a56-9abd-7c30cf5083ac tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] [instance: e28e570d-3d50-4fe8-bb4a-fe0e95c20fb7] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:54:34.347317 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-689b3bd9-db7b-4a56-9abd-7c30cf5083ac tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:34.347867 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-689b3bd9-db7b-4a56-9abd-7c30cf5083ac tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:34.348765 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-689b3bd9-db7b-4a56-9abd-7c30cf5083ac tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:34.349275 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-689b3bd9-db7b-4a56-9abd-7c30cf5083ac tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:34.630340 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-4250443d-ec5d-42d3-bf7b-b13147bdaee5 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90033e5e8e634b699bf050e36519f8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8112a5759c444c1f94be24ab61bf072f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:54:34.638919 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-4250443d-ec5d-42d3-bf7b-b13147bdaee5 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] 10.222.0.26 "GET /compute/v2.1/servers/c24fee69-5bf4-40f4-ba18-56aecd12dd96" status: 200 len: 1566 microversion: 2.1 time: 0.364670 Mar 05 02:54:34.639552 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 162/314] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:54:34 2022] GET /compute/v2.1/servers/c24fee69-5bf4-40f4-ba18-56aecd12dd96 => generated 1566 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 02:54:34.644110 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-51c48610-049e-4022-ae37-7ee03ec18723 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:54:34.644706 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-51c48610-049e-4022-ae37-7ee03ec18723 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] [instance: d0080e4b-6532-4e0c-8d19-cfbdf32e401b] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:54:34.650372 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-51c48610-049e-4022-ae37-7ee03ec18723 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:34.650821 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-51c48610-049e-4022-ae37-7ee03ec18723 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:34.652219 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-51c48610-049e-4022-ae37-7ee03ec18723 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:34.652659 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-51c48610-049e-4022-ae37-7ee03ec18723 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:34.661590 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-689b3bd9-db7b-4a56-9abd-7c30cf5083ac tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:54:34.669898 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-689b3bd9-db7b-4a56-9abd-7c30cf5083ac tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:54:34.672695 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-689b3bd9-db7b-4a56-9abd-7c30cf5083ac tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:54:34.674270 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-689b3bd9-db7b-4a56-9abd-7c30cf5083ac tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] 10.222.0.26 "GET /compute/v2.1/servers/e28e570d-3d50-4fe8-bb4a-fe0e95c20fb7" status: 200 len: 1721 microversion: 2.20 time: 0.339778 Mar 05 02:54:34.674998 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 153/315] 10.222.0.26 () {60 vars in 1276 bytes} [Sat Mar 5 02:54:34 2022] GET /compute/v2.1/servers/e28e570d-3d50-4fe8-bb4a-fe0e95c20fb7 => generated 1721 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 05 02:54:35.019525 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-0cae19a3-8627-4fc8-b960-2db1fe0fe54e tempest-VolumesNegativeTest-1423831724 tempest-VolumesNegativeTest-1423831724-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:54:35.020049 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-0cae19a3-8627-4fc8-b960-2db1fe0fe54e tempest-VolumesNegativeTest-1423831724 tempest-VolumesNegativeTest-1423831724-project] [instance: a8a27b43-73c6-4d5a-87ee-888eda8d677b] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:54:35.026268 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-0cae19a3-8627-4fc8-b960-2db1fe0fe54e tempest-VolumesNegativeTest-1423831724 tempest-VolumesNegativeTest-1423831724-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:35.027010 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-0cae19a3-8627-4fc8-b960-2db1fe0fe54e tempest-VolumesNegativeTest-1423831724 tempest-VolumesNegativeTest-1423831724-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:35.028089 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-0cae19a3-8627-4fc8-b960-2db1fe0fe54e tempest-VolumesNegativeTest-1423831724 tempest-VolumesNegativeTest-1423831724-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:35.028410 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-0cae19a3-8627-4fc8-b960-2db1fe0fe54e tempest-VolumesNegativeTest-1423831724 tempest-VolumesNegativeTest-1423831724-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:35.132390 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-51c48610-049e-4022-ae37-7ee03ec18723 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e5a000087fe40419ccd0d1a96fb4783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9d27da2e71d4962a53a95efc46518ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:54:35.141485 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-51c48610-049e-4022-ae37-7ee03ec18723 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] 10.222.0.26 "GET /compute/v2.1/servers/d0080e4b-6532-4e0c-8d19-cfbdf32e401b" status: 200 len: 1724 microversion: 2.1 time: 0.500026 Mar 05 02:54:35.142780 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 163/316] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:54:34 2022] GET /compute/v2.1/servers/d0080e4b-6532-4e0c-8d19-cfbdf32e401b => generated 1724 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 02:54:35.148303 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-360f19f3-6d85-42f2-b30f-a3490b2e75d9 tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:54:35.149046 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-360f19f3-6d85-42f2-b30f-a3490b2e75d9 tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] [instance: d73f2b8e-9af1-4395-9995-f34cd8187681] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:54:35.158876 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-360f19f3-6d85-42f2-b30f-a3490b2e75d9 tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:35.159771 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-360f19f3-6d85-42f2-b30f-a3490b2e75d9 tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:35.160675 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-360f19f3-6d85-42f2-b30f-a3490b2e75d9 tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:35.161224 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-360f19f3-6d85-42f2-b30f-a3490b2e75d9 tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:35.296147 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-0cae19a3-8627-4fc8-b960-2db1fe0fe54e tempest-VolumesNegativeTest-1423831724 tempest-VolumesNegativeTest-1423831724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2097ae8dee5b4d17a4f4921393c3e70f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6d0875d975e453cab8434d214003ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:54:35.303831 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-0cae19a3-8627-4fc8-b960-2db1fe0fe54e tempest-VolumesNegativeTest-1423831724 tempest-VolumesNegativeTest-1423831724-project] 10.222.0.26 "GET /compute/v2.1/servers/a8a27b43-73c6-4d5a-87ee-888eda8d677b" status: 200 len: 1314 microversion: 2.1 time: 0.288292 Mar 05 02:54:35.304490 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 154/317] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:54:35 2022] GET /compute/v2.1/servers/a8a27b43-73c6-4d5a-87ee-888eda8d677b => generated 1314 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 02:54:35.360664 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-360f19f3-6d85-42f2-b30f-a3490b2e75d9 tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1700aa8052b94f878886b08f94f05831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3afb5b14217e4a54ab03e6233f8aaa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:54:35.376040 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-360f19f3-6d85-42f2-b30f-a3490b2e75d9 tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] 10.222.0.26 "GET /compute/v2.1/servers/d73f2b8e-9af1-4395-9995-f34cd8187681" status: 200 len: 1313 microversion: 2.1 time: 0.231939 Mar 05 02:54:35.376768 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 164/318] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:54:35 2022] GET /compute/v2.1/servers/d73f2b8e-9af1-4395-9995-f34cd8187681 => generated 1313 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 02:54:35.655452 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-71e6dd7e-2d15-40fe-be15-cfa88912f195 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:54:35.656086 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-71e6dd7e-2d15-40fe-be15-cfa88912f195 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] [instance: c24fee69-5bf4-40f4-ba18-56aecd12dd96] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:54:35.662048 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-71e6dd7e-2d15-40fe-be15-cfa88912f195 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:35.662626 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-71e6dd7e-2d15-40fe-be15-cfa88912f195 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:35.663239 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-71e6dd7e-2d15-40fe-be15-cfa88912f195 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:35.663668 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-71e6dd7e-2d15-40fe-be15-cfa88912f195 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:35.693282 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-f3620ac2-e06a-4d55-a7d7-0dd8346fb2c3 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:54:35.693921 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-f3620ac2-e06a-4d55-a7d7-0dd8346fb2c3 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] [instance: e28e570d-3d50-4fe8-bb4a-fe0e95c20fb7] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:54:35.699825 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-f3620ac2-e06a-4d55-a7d7-0dd8346fb2c3 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:35.700270 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-f3620ac2-e06a-4d55-a7d7-0dd8346fb2c3 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:35.701597 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-f3620ac2-e06a-4d55-a7d7-0dd8346fb2c3 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:35.702058 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-f3620ac2-e06a-4d55-a7d7-0dd8346fb2c3 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:35.860529 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-71e6dd7e-2d15-40fe-be15-cfa88912f195 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90033e5e8e634b699bf050e36519f8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8112a5759c444c1f94be24ab61bf072f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:54:35.868102 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-71e6dd7e-2d15-40fe-be15-cfa88912f195 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] 10.222.0.26 "GET /compute/v2.1/servers/c24fee69-5bf4-40f4-ba18-56aecd12dd96" status: 200 len: 1566 microversion: 2.1 time: 0.217133 Mar 05 02:54:35.868678 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 155/319] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:54:35 2022] GET /compute/v2.1/servers/c24fee69-5bf4-40f4-ba18-56aecd12dd96 => generated 1566 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 02:54:35.885618 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-f3620ac2-e06a-4d55-a7d7-0dd8346fb2c3 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:54:35.893938 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-f3620ac2-e06a-4d55-a7d7-0dd8346fb2c3 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:54:35.895456 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-f3620ac2-e06a-4d55-a7d7-0dd8346fb2c3 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:54:35.896606 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-f3620ac2-e06a-4d55-a7d7-0dd8346fb2c3 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] 10.222.0.26 "GET /compute/v2.1/servers/e28e570d-3d50-4fe8-bb4a-fe0e95c20fb7" status: 200 len: 1721 microversion: 2.20 time: 0.207191 Mar 05 02:54:35.897159 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 165/320] 10.222.0.26 () {60 vars in 1276 bytes} [Sat Mar 5 02:54:35 2022] GET /compute/v2.1/servers/e28e570d-3d50-4fe8-bb4a-fe0e95c20fb7 => generated 1721 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 02:54:36.158225 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-77f0d023-a4d6-4d62-be7d-4c76571ca076 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:54:36.158854 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-77f0d023-a4d6-4d62-be7d-4c76571ca076 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] [instance: d0080e4b-6532-4e0c-8d19-cfbdf32e401b] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:54:36.165063 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-77f0d023-a4d6-4d62-be7d-4c76571ca076 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:36.165515 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-77f0d023-a4d6-4d62-be7d-4c76571ca076 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:36.166316 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-77f0d023-a4d6-4d62-be7d-4c76571ca076 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:36.166752 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-77f0d023-a4d6-4d62-be7d-4c76571ca076 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:36.306582 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-77f0d023-a4d6-4d62-be7d-4c76571ca076 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e5a000087fe40419ccd0d1a96fb4783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9d27da2e71d4962a53a95efc46518ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:54:36.314817 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-77f0d023-a4d6-4d62-be7d-4c76571ca076 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] 10.222.0.26 "GET /compute/v2.1/servers/d0080e4b-6532-4e0c-8d19-cfbdf32e401b" status: 200 len: 1724 microversion: 2.1 time: 0.160808 Mar 05 02:54:36.315564 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 156/321] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:54:36 2022] GET /compute/v2.1/servers/d0080e4b-6532-4e0c-8d19-cfbdf32e401b => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 02:54:36.320658 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-34ca1053-0a99-49fa-b2bf-3c534f7bba33 tempest-VolumesNegativeTest-1423831724 tempest-VolumesNegativeTest-1423831724-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:54:36.321289 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-34ca1053-0a99-49fa-b2bf-3c534f7bba33 tempest-VolumesNegativeTest-1423831724 tempest-VolumesNegativeTest-1423831724-project] [instance: a8a27b43-73c6-4d5a-87ee-888eda8d677b] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:54:36.328107 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-34ca1053-0a99-49fa-b2bf-3c534f7bba33 tempest-VolumesNegativeTest-1423831724 tempest-VolumesNegativeTest-1423831724-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:36.328552 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-34ca1053-0a99-49fa-b2bf-3c534f7bba33 tempest-VolumesNegativeTest-1423831724 tempest-VolumesNegativeTest-1423831724-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:36.329310 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-34ca1053-0a99-49fa-b2bf-3c534f7bba33 tempest-VolumesNegativeTest-1423831724 tempest-VolumesNegativeTest-1423831724-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:36.329741 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-34ca1053-0a99-49fa-b2bf-3c534f7bba33 tempest-VolumesNegativeTest-1423831724 tempest-VolumesNegativeTest-1423831724-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:36.394088 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-6fab8545-609b-4b08-947e-ba6246334ff2 tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:54:36.394880 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-6fab8545-609b-4b08-947e-ba6246334ff2 tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] [instance: d73f2b8e-9af1-4395-9995-f34cd8187681] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:54:36.401412 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-6fab8545-609b-4b08-947e-ba6246334ff2 tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:36.401986 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-6fab8545-609b-4b08-947e-ba6246334ff2 tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:36.403056 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-6fab8545-609b-4b08-947e-ba6246334ff2 tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:36.408666 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-6fab8545-609b-4b08-947e-ba6246334ff2 tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:36.499254 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-34ca1053-0a99-49fa-b2bf-3c534f7bba33 tempest-VolumesNegativeTest-1423831724 tempest-VolumesNegativeTest-1423831724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2097ae8dee5b4d17a4f4921393c3e70f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6d0875d975e453cab8434d214003ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:54:36.506522 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-34ca1053-0a99-49fa-b2bf-3c534f7bba33 tempest-VolumesNegativeTest-1423831724 tempest-VolumesNegativeTest-1423831724-project] 10.222.0.26 "GET /compute/v2.1/servers/a8a27b43-73c6-4d5a-87ee-888eda8d677b" status: 200 len: 1464 microversion: 2.1 time: 0.189654 Mar 05 02:54:36.507087 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 166/322] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:54:36 2022] GET /compute/v2.1/servers/a8a27b43-73c6-4d5a-87ee-888eda8d677b => generated 1464 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 02:54:36.546331 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-c56fe270-6da3-488f-acce-1992e1510f2f tempest-VolumesNegativeTest-1423831724 tempest-VolumesNegativeTest-1423831724-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:54:36.546826 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-c56fe270-6da3-488f-acce-1992e1510f2f tempest-VolumesNegativeTest-1423831724 tempest-VolumesNegativeTest-1423831724-project] [instance: a8a27b43-73c6-4d5a-87ee-888eda8d677b] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:54:36.553055 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-c56fe270-6da3-488f-acce-1992e1510f2f tempest-VolumesNegativeTest-1423831724 tempest-VolumesNegativeTest-1423831724-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:36.553503 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-c56fe270-6da3-488f-acce-1992e1510f2f tempest-VolumesNegativeTest-1423831724 tempest-VolumesNegativeTest-1423831724-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:36.554298 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-c56fe270-6da3-488f-acce-1992e1510f2f tempest-VolumesNegativeTest-1423831724 tempest-VolumesNegativeTest-1423831724-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:36.554737 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-c56fe270-6da3-488f-acce-1992e1510f2f tempest-VolumesNegativeTest-1423831724 tempest-VolumesNegativeTest-1423831724-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:36.574273 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-6fab8545-609b-4b08-947e-ba6246334ff2 tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1700aa8052b94f878886b08f94f05831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3afb5b14217e4a54ab03e6233f8aaa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:54:36.578153 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-c56fe270-6da3-488f-acce-1992e1510f2f tempest-VolumesNegativeTest-1423831724 tempest-VolumesNegativeTest-1423831724-project] [instance: a8a27b43-73c6-4d5a-87ee-888eda8d677b] Going to try to terminate instance {{(pid=123545) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 05 02:54:36.581754 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-6fab8545-609b-4b08-947e-ba6246334ff2 tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] 10.222.0.26 "GET /compute/v2.1/servers/d73f2b8e-9af1-4395-9995-f34cd8187681" status: 200 len: 1497 microversion: 2.1 time: 0.191701 Mar 05 02:54:36.582344 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 157/323] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:54:36 2022] GET /compute/v2.1/servers/d73f2b8e-9af1-4395-9995-f34cd8187681 => generated 1497 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 02:54:36.659181 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-c56fe270-6da3-488f-acce-1992e1510f2f tempest-VolumesNegativeTest-1423831724 tempest-VolumesNegativeTest-1423831724-project] 10.222.0.26 "DELETE /compute/v2.1/servers/a8a27b43-73c6-4d5a-87ee-888eda8d677b" status: 204 len: 0 microversion: 2.1 time: 0.117092 Mar 05 02:54:36.660007 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 167/324] 10.222.0.26 () {58 vars in 1238 bytes} [Sat Mar 5 02:54:36 2022] DELETE /compute/v2.1/servers/a8a27b43-73c6-4d5a-87ee-888eda8d677b => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 05 02:54:36.667772 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-c21974f2-5eab-4339-9689-9d12ffd8ab8f tempest-VolumesNegativeTest-1423831724 tempest-VolumesNegativeTest-1423831724-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:54:36.668384 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-c21974f2-5eab-4339-9689-9d12ffd8ab8f tempest-VolumesNegativeTest-1423831724 tempest-VolumesNegativeTest-1423831724-project] [instance: a8a27b43-73c6-4d5a-87ee-888eda8d677b] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:54:36.675037 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-c21974f2-5eab-4339-9689-9d12ffd8ab8f tempest-VolumesNegativeTest-1423831724 tempest-VolumesNegativeTest-1423831724-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:36.675473 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-c21974f2-5eab-4339-9689-9d12ffd8ab8f tempest-VolumesNegativeTest-1423831724 tempest-VolumesNegativeTest-1423831724-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:36.676264 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-c21974f2-5eab-4339-9689-9d12ffd8ab8f tempest-VolumesNegativeTest-1423831724 tempest-VolumesNegativeTest-1423831724-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:36.676769 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-c21974f2-5eab-4339-9689-9d12ffd8ab8f tempest-VolumesNegativeTest-1423831724 tempest-VolumesNegativeTest-1423831724-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:36.820072 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-c21974f2-5eab-4339-9689-9d12ffd8ab8f tempest-VolumesNegativeTest-1423831724 tempest-VolumesNegativeTest-1423831724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2097ae8dee5b4d17a4f4921393c3e70f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6d0875d975e453cab8434d214003ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:54:36.827752 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-c21974f2-5eab-4339-9689-9d12ffd8ab8f tempest-VolumesNegativeTest-1423831724 tempest-VolumesNegativeTest-1423831724-project] 10.222.0.26 "GET /compute/v2.1/servers/a8a27b43-73c6-4d5a-87ee-888eda8d677b" status: 200 len: 1470 microversion: 2.1 time: 0.163787 Mar 05 02:54:36.828324 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 158/325] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:54:36 2022] GET /compute/v2.1/servers/a8a27b43-73c6-4d5a-87ee-888eda8d677b => generated 1470 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 02:54:36.862555 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [req-4934086d-8c18-4a40-9ca3-39846927edef req-58944169-3aa9-4136-b0f7-47490ede496e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e28e570d-3d50-4fe8-bb4a-fe0e95c20fb7", "name": "network-vif-unplugged", "status": "completed", "tag": "f280dd1a-3e15-49a1-9569-b6b40278e2a2"}]} {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 02:54:36.877094 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [req-4934086d-8c18-4a40-9ca3-39846927edef req-58944169-3aa9-4136-b0f7-47490ede496e service nova] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:36.878228 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [req-4934086d-8c18-4a40-9ca3-39846927edef req-58944169-3aa9-4136-b0f7-47490ede496e service nova] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:36.886802 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-c01c1a52-1a63-4452-b4d0-105aa50bcd12 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:54:36.887717 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-c01c1a52-1a63-4452-b4d0-105aa50bcd12 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] [instance: c24fee69-5bf4-40f4-ba18-56aecd12dd96] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:54:36.897371 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-c01c1a52-1a63-4452-b4d0-105aa50bcd12 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:36.898149 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-c01c1a52-1a63-4452-b4d0-105aa50bcd12 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:36.899164 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-c01c1a52-1a63-4452-b4d0-105aa50bcd12 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:36.899760 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-c01c1a52-1a63-4452-b4d0-105aa50bcd12 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:36.905108 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.compute.server_external_events [req-4934086d-8c18-4a40-9ca3-39846927edef req-58944169-3aa9-4136-b0f7-47490ede496e service nova] Creating event network-vif-unplugged:f280dd1a-3e15-49a1-9569-b6b40278e2a2 for instance e28e570d-3d50-4fe8-bb4a-fe0e95c20fb7 on hv-cinder-82725 Mar 05 02:54:36.912159 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [req-4934086d-8c18-4a40-9ca3-39846927edef req-58944169-3aa9-4136-b0f7-47490ede496e service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.054273 Mar 05 02:54:36.912693 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 168/326] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Mar 5 02:54:36 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 02:54:36.918734 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-3ac43995-7c32-47fe-b465-6dbd5e357854 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:54:36.921498 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-3ac43995-7c32-47fe-b465-6dbd5e357854 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] [instance: e28e570d-3d50-4fe8-bb4a-fe0e95c20fb7] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:54:36.929795 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-3ac43995-7c32-47fe-b465-6dbd5e357854 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:36.930657 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-3ac43995-7c32-47fe-b465-6dbd5e357854 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:36.931911 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-3ac43995-7c32-47fe-b465-6dbd5e357854 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:36.932546 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-3ac43995-7c32-47fe-b465-6dbd5e357854 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:37.126481 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-c01c1a52-1a63-4452-b4d0-105aa50bcd12 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90033e5e8e634b699bf050e36519f8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8112a5759c444c1f94be24ab61bf072f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:54:37.130667 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-3ac43995-7c32-47fe-b465-6dbd5e357854 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:54:37.134416 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-c01c1a52-1a63-4452-b4d0-105aa50bcd12 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] 10.222.0.26 "GET /compute/v2.1/servers/c24fee69-5bf4-40f4-ba18-56aecd12dd96" status: 200 len: 1566 microversion: 2.1 time: 0.252666 Mar 05 02:54:37.134990 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 159/327] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:54:36 2022] GET /compute/v2.1/servers/c24fee69-5bf4-40f4-ba18-56aecd12dd96 => generated 1566 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 02:54:37.139653 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-3ac43995-7c32-47fe-b465-6dbd5e357854 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:54:37.141249 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-3ac43995-7c32-47fe-b465-6dbd5e357854 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:54:37.142422 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-3ac43995-7c32-47fe-b465-6dbd5e357854 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] 10.222.0.26 "GET /compute/v2.1/servers/e28e570d-3d50-4fe8-bb4a-fe0e95c20fb7" status: 200 len: 1721 microversion: 2.20 time: 0.228334 Mar 05 02:54:37.143127 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 169/328] 10.222.0.26 () {60 vars in 1276 bytes} [Sat Mar 5 02:54:36 2022] GET /compute/v2.1/servers/e28e570d-3d50-4fe8-bb4a-fe0e95c20fb7 => generated 1721 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 05 02:54:37.173690 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-9f22947c-ef64-432d-98f4-4984cc3fad01 tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:54:37.174157 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-9f22947c-ef64-432d-98f4-4984cc3fad01 tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] [instance: d73f2b8e-9af1-4395-9995-f34cd8187681] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:54:37.180318 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-9f22947c-ef64-432d-98f4-4984cc3fad01 tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:37.180757 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-9f22947c-ef64-432d-98f4-4984cc3fad01 tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:37.181518 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-9f22947c-ef64-432d-98f4-4984cc3fad01 tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:37.181948 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-9f22947c-ef64-432d-98f4-4984cc3fad01 tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:37.208151 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-9f22947c-ef64-432d-98f4-4984cc3fad01 tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] [instance: d73f2b8e-9af1-4395-9995-f34cd8187681] Going to try to terminate instance {{(pid=123546) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 05 02:54:37.289246 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-9f22947c-ef64-432d-98f4-4984cc3fad01 tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] 10.222.0.26 "DELETE /compute/v2.1/servers/d73f2b8e-9af1-4395-9995-f34cd8187681" status: 204 len: 0 microversion: 2.1 time: 0.119557 Mar 05 02:54:37.289826 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 160/329] 10.222.0.26 () {58 vars in 1238 bytes} [Sat Mar 5 02:54:37 2022] DELETE /compute/v2.1/servers/d73f2b8e-9af1-4395-9995-f34cd8187681 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 05 02:54:37.298645 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-d7bbdf66-d853-4b12-8c73-5038b7e33067 tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:54:37.299434 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-d7bbdf66-d853-4b12-8c73-5038b7e33067 tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] [instance: d73f2b8e-9af1-4395-9995-f34cd8187681] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:54:37.305905 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-d7bbdf66-d853-4b12-8c73-5038b7e33067 tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:37.306424 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-d7bbdf66-d853-4b12-8c73-5038b7e33067 tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:37.307202 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-d7bbdf66-d853-4b12-8c73-5038b7e33067 tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:37.307812 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-d7bbdf66-d853-4b12-8c73-5038b7e33067 tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:37.331751 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-e4373873-b195-436b-ba8e-378cb7f17eb2 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:54:37.332779 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-e4373873-b195-436b-ba8e-378cb7f17eb2 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] [instance: d0080e4b-6532-4e0c-8d19-cfbdf32e401b] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:54:37.338602 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-e4373873-b195-436b-ba8e-378cb7f17eb2 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:37.339054 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-e4373873-b195-436b-ba8e-378cb7f17eb2 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:37.339817 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-e4373873-b195-436b-ba8e-378cb7f17eb2 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:37.340245 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-e4373873-b195-436b-ba8e-378cb7f17eb2 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:37.515373 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-d7bbdf66-d853-4b12-8c73-5038b7e33067 tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1700aa8052b94f878886b08f94f05831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3afb5b14217e4a54ab03e6233f8aaa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:54:37.522803 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-d7bbdf66-d853-4b12-8c73-5038b7e33067 tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] 10.222.0.26 "GET /compute/v2.1/servers/d73f2b8e-9af1-4395-9995-f34cd8187681" status: 200 len: 1503 microversion: 2.1 time: 0.228513 Mar 05 02:54:37.523677 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 170/330] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:54:37 2022] GET /compute/v2.1/servers/d73f2b8e-9af1-4395-9995-f34cd8187681 => generated 1503 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 02:54:37.526332 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-e4373873-b195-436b-ba8e-378cb7f17eb2 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e5a000087fe40419ccd0d1a96fb4783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9d27da2e71d4962a53a95efc46518ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:54:37.534576 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-e4373873-b195-436b-ba8e-378cb7f17eb2 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] 10.222.0.26 "GET /compute/v2.1/servers/d0080e4b-6532-4e0c-8d19-cfbdf32e401b" status: 200 len: 1724 microversion: 2.1 time: 0.207095 Mar 05 02:54:37.535152 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 161/331] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:54:37 2022] GET /compute/v2.1/servers/d0080e4b-6532-4e0c-8d19-cfbdf32e401b => generated 1724 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 02:54:37.845683 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-a4e85380-b11e-4ee9-ab06-a2cb03b758c9 tempest-VolumesNegativeTest-1423831724 tempest-VolumesNegativeTest-1423831724-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:54:37.846327 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-a4e85380-b11e-4ee9-ab06-a2cb03b758c9 tempest-VolumesNegativeTest-1423831724 tempest-VolumesNegativeTest-1423831724-project] [instance: a8a27b43-73c6-4d5a-87ee-888eda8d677b] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:54:37.852800 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-a4e85380-b11e-4ee9-ab06-a2cb03b758c9 tempest-VolumesNegativeTest-1423831724 tempest-VolumesNegativeTest-1423831724-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:37.853340 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-a4e85380-b11e-4ee9-ab06-a2cb03b758c9 tempest-VolumesNegativeTest-1423831724 tempest-VolumesNegativeTest-1423831724-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:37.854436 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-a4e85380-b11e-4ee9-ab06-a2cb03b758c9 tempest-VolumesNegativeTest-1423831724 tempest-VolumesNegativeTest-1423831724-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:37.854870 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-a4e85380-b11e-4ee9-ab06-a2cb03b758c9 tempest-VolumesNegativeTest-1423831724 tempest-VolumesNegativeTest-1423831724-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:37.987656 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-a4e85380-b11e-4ee9-ab06-a2cb03b758c9 tempest-VolumesNegativeTest-1423831724 tempest-VolumesNegativeTest-1423831724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2097ae8dee5b4d17a4f4921393c3e70f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6d0875d975e453cab8434d214003ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:54:37.996907 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-a4e85380-b11e-4ee9-ab06-a2cb03b758c9 tempest-VolumesNegativeTest-1423831724 tempest-VolumesNegativeTest-1423831724-project] 10.222.0.26 "GET /compute/v2.1/servers/a8a27b43-73c6-4d5a-87ee-888eda8d677b" status: 200 len: 1470 microversion: 2.1 time: 0.155211 Mar 05 02:54:37.997491 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 171/332] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:54:37 2022] GET /compute/v2.1/servers/a8a27b43-73c6-4d5a-87ee-888eda8d677b => generated 1470 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 02:54:38.152273 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-0b4bf2d7-7c7f-4e63-89cc-57c2d276b73b tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:54:38.152872 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-0b4bf2d7-7c7f-4e63-89cc-57c2d276b73b tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] [instance: c24fee69-5bf4-40f4-ba18-56aecd12dd96] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:54:38.159815 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-0b4bf2d7-7c7f-4e63-89cc-57c2d276b73b tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:38.160267 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-0b4bf2d7-7c7f-4e63-89cc-57c2d276b73b tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:38.160553 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-1054a874-b606-4cc8-99f1-cabc14749835 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:54:38.161034 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-0b4bf2d7-7c7f-4e63-89cc-57c2d276b73b tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:38.161325 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-1054a874-b606-4cc8-99f1-cabc14749835 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] [instance: e28e570d-3d50-4fe8-bb4a-fe0e95c20fb7] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:54:38.161465 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-0b4bf2d7-7c7f-4e63-89cc-57c2d276b73b tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:38.167112 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-1054a874-b606-4cc8-99f1-cabc14749835 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:38.167566 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-1054a874-b606-4cc8-99f1-cabc14749835 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:38.168602 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-1054a874-b606-4cc8-99f1-cabc14749835 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:38.170487 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-1054a874-b606-4cc8-99f1-cabc14749835 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:38.369203 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-0b4bf2d7-7c7f-4e63-89cc-57c2d276b73b tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90033e5e8e634b699bf050e36519f8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8112a5759c444c1f94be24ab61bf072f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:54:38.373396 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-1054a874-b606-4cc8-99f1-cabc14749835 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:54:38.377817 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-0b4bf2d7-7c7f-4e63-89cc-57c2d276b73b tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] 10.222.0.26 "GET /compute/v2.1/servers/c24fee69-5bf4-40f4-ba18-56aecd12dd96" status: 200 len: 1566 microversion: 2.1 time: 0.229654 Mar 05 02:54:38.378434 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 162/333] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:54:38 2022] GET /compute/v2.1/servers/c24fee69-5bf4-40f4-ba18-56aecd12dd96 => generated 1566 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 02:54:38.381607 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-1054a874-b606-4cc8-99f1-cabc14749835 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:54:38.383222 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-1054a874-b606-4cc8-99f1-cabc14749835 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:54:38.384481 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-1054a874-b606-4cc8-99f1-cabc14749835 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] 10.222.0.26 "GET /compute/v2.1/servers/e28e570d-3d50-4fe8-bb4a-fe0e95c20fb7" status: 200 len: 1664 microversion: 2.20 time: 0.227729 Mar 05 02:54:38.385102 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 172/334] 10.222.0.26 () {60 vars in 1276 bytes} [Sat Mar 5 02:54:38 2022] GET /compute/v2.1/servers/e28e570d-3d50-4fe8-bb4a-fe0e95c20fb7 => generated 1664 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 05 02:54:38.403365 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-bd356f9c-c515-46ec-b142-fe572124e69f tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cd9baecf-cd8c-48c1-a01f-64e74a21aa5a"}} {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 02:54:38.405255 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-bd356f9c-c515-46ec-b142-fe572124e69f tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] [instance: e28e570d-3d50-4fe8-bb4a-fe0e95c20fb7] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:54:38.411072 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-bd356f9c-c515-46ec-b142-fe572124e69f tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:38.411510 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-bd356f9c-c515-46ec-b142-fe572124e69f tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:38.412264 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-bd356f9c-c515-46ec-b142-fe572124e69f tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:38.412693 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-bd356f9c-c515-46ec-b142-fe572124e69f tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:38.541173 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-1ccf18a5-cd32-4d09-a6ce-4bf2d5389053 tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:54:38.541884 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-1ccf18a5-cd32-4d09-a6ce-4bf2d5389053 tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] [instance: d73f2b8e-9af1-4395-9995-f34cd8187681] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:54:38.548635 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-1ccf18a5-cd32-4d09-a6ce-4bf2d5389053 tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:38.549271 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-1ccf18a5-cd32-4d09-a6ce-4bf2d5389053 tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:38.550328 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-1ccf18a5-cd32-4d09-a6ce-4bf2d5389053 tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:38.550995 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-1ccf18a5-cd32-4d09-a6ce-4bf2d5389053 tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:38.695929 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-1ccf18a5-cd32-4d09-a6ce-4bf2d5389053 tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1700aa8052b94f878886b08f94f05831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3afb5b14217e4a54ab03e6233f8aaa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:54:38.696963 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-bd356f9c-c515-46ec-b142-fe572124e69f tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] 10.222.0.26 "POST /compute/v2.1/servers/e28e570d-3d50-4fe8-bb4a-fe0e95c20fb7/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.297529 Mar 05 02:54:38.697569 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 163/335] 10.222.0.26 () {62 vars in 1363 bytes} [Sat Mar 5 02:54:38 2022] POST /compute/v2.1/servers/e28e570d-3d50-4fe8-bb4a-fe0e95c20fb7/os-volume_attachments => generated 188 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 05 02:54:38.703169 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-d160b840-1f63-4c44-8131-5da1e896374e tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:54:38.703777 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-d160b840-1f63-4c44-8131-5da1e896374e tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] [instance: d0080e4b-6532-4e0c-8d19-cfbdf32e401b] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:54:38.704469 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-1ccf18a5-cd32-4d09-a6ce-4bf2d5389053 tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] 10.222.0.26 "GET /compute/v2.1/servers/d73f2b8e-9af1-4395-9995-f34cd8187681" status: 200 len: 1503 microversion: 2.1 time: 0.167578 Mar 05 02:54:38.705037 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 173/336] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:54:38 2022] GET /compute/v2.1/servers/d73f2b8e-9af1-4395-9995-f34cd8187681 => generated 1503 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 02:54:38.711788 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-d160b840-1f63-4c44-8131-5da1e896374e tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:38.712238 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-d160b840-1f63-4c44-8131-5da1e896374e tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:38.713039 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-d160b840-1f63-4c44-8131-5da1e896374e tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:38.713614 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-d160b840-1f63-4c44-8131-5da1e896374e tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:38.820675 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-f3d4a488-aac5-44d6-841d-bd7aed89062b tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 02:54:38.821243 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-f3d4a488-aac5-44d6-841d-bd7aed89062b tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] [instance: e28e570d-3d50-4fe8-bb4a-fe0e95c20fb7] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:54:38.827851 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-f3d4a488-aac5-44d6-841d-bd7aed89062b tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:38.828547 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-f3d4a488-aac5-44d6-841d-bd7aed89062b tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:38.829335 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-f3d4a488-aac5-44d6-841d-bd7aed89062b tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:38.829772 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-f3d4a488-aac5-44d6-841d-bd7aed89062b tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:38.899481 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-d160b840-1f63-4c44-8131-5da1e896374e tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e5a000087fe40419ccd0d1a96fb4783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9d27da2e71d4962a53a95efc46518ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:54:38.910432 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-d160b840-1f63-4c44-8131-5da1e896374e tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] 10.222.0.26 "GET /compute/v2.1/servers/d0080e4b-6532-4e0c-8d19-cfbdf32e401b" status: 200 len: 1724 microversion: 2.1 time: 0.211390 Mar 05 02:54:38.911022 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 164/337] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:54:38 2022] GET /compute/v2.1/servers/d0080e4b-6532-4e0c-8d19-cfbdf32e401b => generated 1724 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 02:54:38.930642 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-f3d4a488-aac5-44d6-841d-bd7aed89062b tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] 10.222.0.26 "POST /compute/v2.1/servers/e28e570d-3d50-4fe8-bb4a-fe0e95c20fb7/action" status: 202 len: 0 microversion: 2.20 time: 0.113722 Mar 05 02:54:38.931518 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 174/338] 10.222.0.26 () {62 vars in 1318 bytes} [Sat Mar 5 02:54:38 2022] POST /compute/v2.1/servers/e28e570d-3d50-4fe8-bb4a-fe0e95c20fb7/action => generated 0 bytes in 115 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Mar 05 02:54:38.941073 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-76650dfb-4bc6-4af1-b478-474fe35cd35e tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:54:38.942151 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-76650dfb-4bc6-4af1-b478-474fe35cd35e tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] [instance: e28e570d-3d50-4fe8-bb4a-fe0e95c20fb7] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:54:38.947738 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-76650dfb-4bc6-4af1-b478-474fe35cd35e tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:38.948196 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-76650dfb-4bc6-4af1-b478-474fe35cd35e tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:38.948976 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-76650dfb-4bc6-4af1-b478-474fe35cd35e tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:38.949417 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-76650dfb-4bc6-4af1-b478-474fe35cd35e tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:39.014748 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-3f7a3f0b-ceee-4074-a17b-7f662847a968 tempest-VolumesNegativeTest-1423831724 tempest-VolumesNegativeTest-1423831724-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:54:39.016002 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-3f7a3f0b-ceee-4074-a17b-7f662847a968 tempest-VolumesNegativeTest-1423831724 tempest-VolumesNegativeTest-1423831724-project] [instance: a8a27b43-73c6-4d5a-87ee-888eda8d677b] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:54:39.023089 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-3f7a3f0b-ceee-4074-a17b-7f662847a968 tempest-VolumesNegativeTest-1423831724 tempest-VolumesNegativeTest-1423831724-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:39.023544 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-3f7a3f0b-ceee-4074-a17b-7f662847a968 tempest-VolumesNegativeTest-1423831724 tempest-VolumesNegativeTest-1423831724-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:39.024539 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-3f7a3f0b-ceee-4074-a17b-7f662847a968 tempest-VolumesNegativeTest-1423831724 tempest-VolumesNegativeTest-1423831724-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:39.025362 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-3f7a3f0b-ceee-4074-a17b-7f662847a968 tempest-VolumesNegativeTest-1423831724 tempest-VolumesNegativeTest-1423831724-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:39.236903 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-76650dfb-4bc6-4af1-b478-474fe35cd35e tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:54:39.246123 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-76650dfb-4bc6-4af1-b478-474fe35cd35e tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:54:39.249093 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-76650dfb-4bc6-4af1-b478-474fe35cd35e tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:54:39.249093 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-76650dfb-4bc6-4af1-b478-474fe35cd35e tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] 10.222.0.26 "GET /compute/v2.1/servers/e28e570d-3d50-4fe8-bb4a-fe0e95c20fb7" status: 200 len: 1750 microversion: 2.20 time: 0.311994 Mar 05 02:54:39.249514 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 165/339] 10.222.0.26 () {60 vars in 1276 bytes} [Sat Mar 5 02:54:38 2022] GET /compute/v2.1/servers/e28e570d-3d50-4fe8-bb4a-fe0e95c20fb7 => generated 1750 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 05 02:54:39.349667 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-3f7a3f0b-ceee-4074-a17b-7f662847a968 tempest-VolumesNegativeTest-1423831724 tempest-VolumesNegativeTest-1423831724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2097ae8dee5b4d17a4f4921393c3e70f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6d0875d975e453cab8434d214003ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:54:39.356753 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-3f7a3f0b-ceee-4074-a17b-7f662847a968 tempest-VolumesNegativeTest-1423831724 tempest-VolumesNegativeTest-1423831724-project] 10.222.0.26 "GET /compute/v2.1/servers/a8a27b43-73c6-4d5a-87ee-888eda8d677b" status: 200 len: 1470 microversion: 2.1 time: 0.346539 Mar 05 02:54:39.357596 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 175/340] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:54:39 2022] GET /compute/v2.1/servers/a8a27b43-73c6-4d5a-87ee-888eda8d677b => generated 1470 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 02:54:39.394833 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-9dba616f-8d27-4239-99a3-b7683c039d04 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:54:39.395772 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-9dba616f-8d27-4239-99a3-b7683c039d04 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] [instance: c24fee69-5bf4-40f4-ba18-56aecd12dd96] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:54:39.401506 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-9dba616f-8d27-4239-99a3-b7683c039d04 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:39.401976 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-9dba616f-8d27-4239-99a3-b7683c039d04 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:39.402749 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-9dba616f-8d27-4239-99a3-b7683c039d04 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:39.403205 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-9dba616f-8d27-4239-99a3-b7683c039d04 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:39.605893 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [req-3f5759bf-20a7-478b-aab5-3a954722d0fe req-4ab315f3-1a19-4336-84d3-f2562fc69be6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8a27b43-73c6-4d5a-87ee-888eda8d677b", "name": "network-vif-deleted", "tag": "67df0ed3-4a7f-4353-a18d-274a902ce784"}]} {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 02:54:39.615715 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [req-3f5759bf-20a7-478b-aab5-3a954722d0fe req-4ab315f3-1a19-4336-84d3-f2562fc69be6 service nova] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:39.616561 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [req-3f5759bf-20a7-478b-aab5-3a954722d0fe req-4ab315f3-1a19-4336-84d3-f2562fc69be6 service nova] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:39.632298 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.compute.server_external_events [req-3f5759bf-20a7-478b-aab5-3a954722d0fe req-4ab315f3-1a19-4336-84d3-f2562fc69be6 service nova] Creating event network-vif-deleted:67df0ed3-4a7f-4353-a18d-274a902ce784 for instance a8a27b43-73c6-4d5a-87ee-888eda8d677b on hv-cinder-82725 Mar 05 02:54:39.641762 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [req-3f5759bf-20a7-478b-aab5-3a954722d0fe req-4ab315f3-1a19-4336-84d3-f2562fc69be6 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042735 Mar 05 02:54:39.642725 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 176/341] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Mar 5 02:54:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 05 02:54:39.715230 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-9dba616f-8d27-4239-99a3-b7683c039d04 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90033e5e8e634b699bf050e36519f8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8112a5759c444c1f94be24ab61bf072f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:54:39.723196 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-1fd02929-dbf0-4016-aeb2-e6a1b1d78afb tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:54:39.724052 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-1fd02929-dbf0-4016-aeb2-e6a1b1d78afb tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] [instance: d73f2b8e-9af1-4395-9995-f34cd8187681] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:54:39.731943 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-1fd02929-dbf0-4016-aeb2-e6a1b1d78afb tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:39.733018 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-1fd02929-dbf0-4016-aeb2-e6a1b1d78afb tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:39.734012 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-1fd02929-dbf0-4016-aeb2-e6a1b1d78afb tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:39.734864 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-1fd02929-dbf0-4016-aeb2-e6a1b1d78afb tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:39.745847 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-9dba616f-8d27-4239-99a3-b7683c039d04 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] 10.222.0.26 "GET /compute/v2.1/servers/c24fee69-5bf4-40f4-ba18-56aecd12dd96" status: 200 len: 1566 microversion: 2.1 time: 0.354802 Mar 05 02:54:39.746918 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 166/342] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:54:39 2022] GET /compute/v2.1/servers/c24fee69-5bf4-40f4-ba18-56aecd12dd96 => generated 1566 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 02:54:39.927780 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-3ce9e1bd-d072-4b99-ba61-4ec9496ffc6d tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:54:39.928379 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-3ce9e1bd-d072-4b99-ba61-4ec9496ffc6d tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] [instance: d0080e4b-6532-4e0c-8d19-cfbdf32e401b] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:54:39.934054 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-3ce9e1bd-d072-4b99-ba61-4ec9496ffc6d tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:39.934503 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-3ce9e1bd-d072-4b99-ba61-4ec9496ffc6d tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:39.935403 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-3ce9e1bd-d072-4b99-ba61-4ec9496ffc6d tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:39.935836 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-3ce9e1bd-d072-4b99-ba61-4ec9496ffc6d tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:39.976967 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-1fd02929-dbf0-4016-aeb2-e6a1b1d78afb tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1700aa8052b94f878886b08f94f05831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3afb5b14217e4a54ab03e6233f8aaa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:54:39.984736 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-1fd02929-dbf0-4016-aeb2-e6a1b1d78afb tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] 10.222.0.26 "GET /compute/v2.1/servers/d73f2b8e-9af1-4395-9995-f34cd8187681" status: 200 len: 1503 microversion: 2.1 time: 0.266124 Mar 05 02:54:39.985450 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 177/343] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:54:39 2022] GET /compute/v2.1/servers/d73f2b8e-9af1-4395-9995-f34cd8187681 => generated 1503 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 02:54:40.176125 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-3ce9e1bd-d072-4b99-ba61-4ec9496ffc6d tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e5a000087fe40419ccd0d1a96fb4783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9d27da2e71d4962a53a95efc46518ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:54:40.187335 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-3ce9e1bd-d072-4b99-ba61-4ec9496ffc6d tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] 10.222.0.26 "GET /compute/v2.1/servers/d0080e4b-6532-4e0c-8d19-cfbdf32e401b" status: 200 len: 1724 microversion: 2.1 time: 0.263310 Mar 05 02:54:40.188334 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 167/344] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:54:39 2022] GET /compute/v2.1/servers/d0080e4b-6532-4e0c-8d19-cfbdf32e401b => generated 1724 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 02:54:40.267757 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-0a8777e8-70ff-4644-8177-bdab63bd23d9 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:54:40.268502 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-0a8777e8-70ff-4644-8177-bdab63bd23d9 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] [instance: e28e570d-3d50-4fe8-bb4a-fe0e95c20fb7] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:54:40.274836 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-0a8777e8-70ff-4644-8177-bdab63bd23d9 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:40.275608 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-0a8777e8-70ff-4644-8177-bdab63bd23d9 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:40.277108 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-0a8777e8-70ff-4644-8177-bdab63bd23d9 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:40.277602 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-0a8777e8-70ff-4644-8177-bdab63bd23d9 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:40.374920 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-24d5a15a-4aa4-4fac-8211-526b940aad1b tempest-VolumesNegativeTest-1423831724 tempest-VolumesNegativeTest-1423831724-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:54:40.376207 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-24d5a15a-4aa4-4fac-8211-526b940aad1b tempest-VolumesNegativeTest-1423831724 tempest-VolumesNegativeTest-1423831724-project] [instance: a8a27b43-73c6-4d5a-87ee-888eda8d677b] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:54:40.382301 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-24d5a15a-4aa4-4fac-8211-526b940aad1b tempest-VolumesNegativeTest-1423831724 tempest-VolumesNegativeTest-1423831724-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:40.382759 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-24d5a15a-4aa4-4fac-8211-526b940aad1b tempest-VolumesNegativeTest-1423831724 tempest-VolumesNegativeTest-1423831724-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:40.383628 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-24d5a15a-4aa4-4fac-8211-526b940aad1b tempest-VolumesNegativeTest-1423831724 tempest-VolumesNegativeTest-1423831724-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:40.384068 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-24d5a15a-4aa4-4fac-8211-526b940aad1b tempest-VolumesNegativeTest-1423831724 tempest-VolumesNegativeTest-1423831724-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:40.398986 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.wsgi [None req-24d5a15a-4aa4-4fac-8211-526b940aad1b tempest-VolumesNegativeTest-1423831724 tempest-VolumesNegativeTest-1423831724-project] HTTP exception thrown: Instance a8a27b43-73c6-4d5a-87ee-888eda8d677b could not be found. Mar 05 02:54:40.399588 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-24d5a15a-4aa4-4fac-8211-526b940aad1b tempest-VolumesNegativeTest-1423831724 tempest-VolumesNegativeTest-1423831724-project] Returning 404 to user: Instance a8a27b43-73c6-4d5a-87ee-888eda8d677b could not be found. {{(pid=123546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 02:54:40.400612 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-24d5a15a-4aa4-4fac-8211-526b940aad1b tempest-VolumesNegativeTest-1423831724 tempest-VolumesNegativeTest-1423831724-project] 10.222.0.26 "GET /compute/v2.1/servers/a8a27b43-73c6-4d5a-87ee-888eda8d677b" status: 404 len: 111 microversion: 2.1 time: 0.030718 Mar 05 02:54:40.401633 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 168/345] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:54:40 2022] GET /compute/v2.1/servers/a8a27b43-73c6-4d5a-87ee-888eda8d677b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 05 02:54:40.423753 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-0a8777e8-70ff-4644-8177-bdab63bd23d9 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:54:40.432083 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-0a8777e8-70ff-4644-8177-bdab63bd23d9 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:54:40.433590 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-0a8777e8-70ff-4644-8177-bdab63bd23d9 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:54:40.434773 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-0a8777e8-70ff-4644-8177-bdab63bd23d9 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] 10.222.0.26 "GET /compute/v2.1/servers/e28e570d-3d50-4fe8-bb4a-fe0e95c20fb7" status: 200 len: 1750 microversion: 2.20 time: 0.171095 Mar 05 02:54:40.435581 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 178/346] 10.222.0.26 () {60 vars in 1276 bytes} [Sat Mar 5 02:54:40 2022] GET /compute/v2.1/servers/e28e570d-3d50-4fe8-bb4a-fe0e95c20fb7 => generated 1750 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 05 02:54:40.764008 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-e0c1b811-002c-476b-9f97-a1e1f1bffdc7 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:54:40.764975 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-e0c1b811-002c-476b-9f97-a1e1f1bffdc7 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] [instance: c24fee69-5bf4-40f4-ba18-56aecd12dd96] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:54:40.774863 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-e0c1b811-002c-476b-9f97-a1e1f1bffdc7 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:40.775468 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-e0c1b811-002c-476b-9f97-a1e1f1bffdc7 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:40.776403 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-e0c1b811-002c-476b-9f97-a1e1f1bffdc7 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:40.777004 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-e0c1b811-002c-476b-9f97-a1e1f1bffdc7 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:40.930441 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-e0c1b811-002c-476b-9f97-a1e1f1bffdc7 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90033e5e8e634b699bf050e36519f8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8112a5759c444c1f94be24ab61bf072f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:54:40.939244 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-e0c1b811-002c-476b-9f97-a1e1f1bffdc7 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] 10.222.0.26 "GET /compute/v2.1/servers/c24fee69-5bf4-40f4-ba18-56aecd12dd96" status: 200 len: 1566 microversion: 2.1 time: 0.180094 Mar 05 02:54:40.939754 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 169/347] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:54:40 2022] GET /compute/v2.1/servers/c24fee69-5bf4-40f4-ba18-56aecd12dd96 => generated 1566 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 02:54:41.002546 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-3b3eb868-bf8c-4408-b77a-a70458501012 tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:54:41.003151 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-3b3eb868-bf8c-4408-b77a-a70458501012 tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] [instance: d73f2b8e-9af1-4395-9995-f34cd8187681] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:54:41.009211 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-3b3eb868-bf8c-4408-b77a-a70458501012 tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:41.009674 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-3b3eb868-bf8c-4408-b77a-a70458501012 tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:41.010480 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-3b3eb868-bf8c-4408-b77a-a70458501012 tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:41.010922 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-3b3eb868-bf8c-4408-b77a-a70458501012 tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:41.024622 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.wsgi [None req-3b3eb868-bf8c-4408-b77a-a70458501012 tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] HTTP exception thrown: Instance d73f2b8e-9af1-4395-9995-f34cd8187681 could not be found. Mar 05 02:54:41.025206 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-3b3eb868-bf8c-4408-b77a-a70458501012 tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] Returning 404 to user: Instance d73f2b8e-9af1-4395-9995-f34cd8187681 could not be found. {{(pid=123545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 02:54:41.026051 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-3b3eb868-bf8c-4408-b77a-a70458501012 tempest-VolumesActionsTest-482213318 tempest-VolumesActionsTest-482213318-project] 10.222.0.26 "GET /compute/v2.1/servers/d73f2b8e-9af1-4395-9995-f34cd8187681" status: 404 len: 111 microversion: 2.1 time: 0.027333 Mar 05 02:54:41.026570 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 179/348] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:54:40 2022] GET /compute/v2.1/servers/d73f2b8e-9af1-4395-9995-f34cd8187681 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 05 02:54:41.205757 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-b041f527-065f-40eb-bc62-13f346e98a20 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:54:41.206612 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-b041f527-065f-40eb-bc62-13f346e98a20 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] [instance: d0080e4b-6532-4e0c-8d19-cfbdf32e401b] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:54:41.222397 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-b041f527-065f-40eb-bc62-13f346e98a20 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:41.222862 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-b041f527-065f-40eb-bc62-13f346e98a20 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:41.223688 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-b041f527-065f-40eb-bc62-13f346e98a20 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:41.224129 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-b041f527-065f-40eb-bc62-13f346e98a20 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:41.377857 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-b041f527-065f-40eb-bc62-13f346e98a20 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e5a000087fe40419ccd0d1a96fb4783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9d27da2e71d4962a53a95efc46518ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:54:41.395438 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-b041f527-065f-40eb-bc62-13f346e98a20 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] 10.222.0.26 "GET /compute/v2.1/servers/d0080e4b-6532-4e0c-8d19-cfbdf32e401b" status: 200 len: 1724 microversion: 2.1 time: 0.194673 Mar 05 02:54:41.411346 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 170/349] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:54:41 2022] GET /compute/v2.1/servers/d0080e4b-6532-4e0c-8d19-cfbdf32e401b => generated 1724 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 02:54:41.453419 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-b4a5a3ac-01c5-41c2-8165-712505d5022f tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:54:41.454645 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-b4a5a3ac-01c5-41c2-8165-712505d5022f tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] [instance: e28e570d-3d50-4fe8-bb4a-fe0e95c20fb7] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:54:41.462377 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-b4a5a3ac-01c5-41c2-8165-712505d5022f tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:41.463164 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-b4a5a3ac-01c5-41c2-8165-712505d5022f tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:41.464115 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-b4a5a3ac-01c5-41c2-8165-712505d5022f tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:41.464780 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-b4a5a3ac-01c5-41c2-8165-712505d5022f tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:41.649627 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-b4a5a3ac-01c5-41c2-8165-712505d5022f tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:54:41.660856 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-b4a5a3ac-01c5-41c2-8165-712505d5022f tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:54:41.662774 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [req-f7eaa9d1-8813-4c2b-8438-30be64077c04 req-9064cddf-fd94-46f3-82cb-10c2e98fc4f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d73f2b8e-9af1-4395-9995-f34cd8187681", "name": "network-vif-deleted", "tag": "63cfcfd4-050a-4cef-9d98-a1860af5f5ca"}]} {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 02:54:41.668574 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-b4a5a3ac-01c5-41c2-8165-712505d5022f tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:54:41.670551 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-b4a5a3ac-01c5-41c2-8165-712505d5022f tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] 10.222.0.26 "GET /compute/v2.1/servers/e28e570d-3d50-4fe8-bb4a-fe0e95c20fb7" status: 200 len: 1750 microversion: 2.20 time: 0.221784 Mar 05 02:54:41.671857 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 180/350] 10.222.0.26 () {60 vars in 1276 bytes} [Sat Mar 5 02:54:41 2022] GET /compute/v2.1/servers/e28e570d-3d50-4fe8-bb4a-fe0e95c20fb7 => generated 1750 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 02:54:41.692598 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [req-f7eaa9d1-8813-4c2b-8438-30be64077c04 req-9064cddf-fd94-46f3-82cb-10c2e98fc4f1 service nova] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:41.694870 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [req-f7eaa9d1-8813-4c2b-8438-30be64077c04 req-9064cddf-fd94-46f3-82cb-10c2e98fc4f1 service nova] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:41.736419 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.compute.server_external_events [req-f7eaa9d1-8813-4c2b-8438-30be64077c04 req-9064cddf-fd94-46f3-82cb-10c2e98fc4f1 service nova] Creating event network-vif-deleted:63cfcfd4-050a-4cef-9d98-a1860af5f5ca for instance d73f2b8e-9af1-4395-9995-f34cd8187681 on hv-cinder-82725 Mar 05 02:54:41.750099 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [req-f7eaa9d1-8813-4c2b-8438-30be64077c04 req-9064cddf-fd94-46f3-82cb-10c2e98fc4f1 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091789 Mar 05 02:54:41.751059 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 171/351] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Mar 5 02:54:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 05 02:54:41.955968 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-1aed6dc0-28a0-44d6-9fb3-f9a9ef0812f5 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:54:41.956593 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-1aed6dc0-28a0-44d6-9fb3-f9a9ef0812f5 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] [instance: c24fee69-5bf4-40f4-ba18-56aecd12dd96] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:54:41.962870 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-1aed6dc0-28a0-44d6-9fb3-f9a9ef0812f5 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:41.963324 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-1aed6dc0-28a0-44d6-9fb3-f9a9ef0812f5 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:41.964107 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-1aed6dc0-28a0-44d6-9fb3-f9a9ef0812f5 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:41.964547 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-1aed6dc0-28a0-44d6-9fb3-f9a9ef0812f5 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:42.147836 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-1aed6dc0-28a0-44d6-9fb3-f9a9ef0812f5 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90033e5e8e634b699bf050e36519f8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8112a5759c444c1f94be24ab61bf072f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:54:42.158284 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-1aed6dc0-28a0-44d6-9fb3-f9a9ef0812f5 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] 10.222.0.26 "GET /compute/v2.1/servers/c24fee69-5bf4-40f4-ba18-56aecd12dd96" status: 200 len: 1566 microversion: 2.1 time: 0.206758 Mar 05 02:54:42.160034 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 181/352] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:54:41 2022] GET /compute/v2.1/servers/c24fee69-5bf4-40f4-ba18-56aecd12dd96 => generated 1566 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 02:54:42.413768 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-a84c4e73-21d3-4904-b960-3e825114f516 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:54:42.414485 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-a84c4e73-21d3-4904-b960-3e825114f516 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] [instance: d0080e4b-6532-4e0c-8d19-cfbdf32e401b] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:54:42.421413 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-a84c4e73-21d3-4904-b960-3e825114f516 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:42.421894 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-a84c4e73-21d3-4904-b960-3e825114f516 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:42.422730 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-a84c4e73-21d3-4904-b960-3e825114f516 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:42.423162 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-a84c4e73-21d3-4904-b960-3e825114f516 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:42.586526 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-a84c4e73-21d3-4904-b960-3e825114f516 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e5a000087fe40419ccd0d1a96fb4783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9d27da2e71d4962a53a95efc46518ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:54:42.595371 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-a84c4e73-21d3-4904-b960-3e825114f516 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] 10.222.0.26 "GET /compute/v2.1/servers/d0080e4b-6532-4e0c-8d19-cfbdf32e401b" status: 200 len: 1724 microversion: 2.1 time: 0.186261 Mar 05 02:54:42.596099 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 172/353] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:54:42 2022] GET /compute/v2.1/servers/d0080e4b-6532-4e0c-8d19-cfbdf32e401b => generated 1724 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 02:54:42.695883 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-3450de55-20ea-4608-b7ee-e5d4a33f293e tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:54:42.701636 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-3450de55-20ea-4608-b7ee-e5d4a33f293e tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] [instance: e28e570d-3d50-4fe8-bb4a-fe0e95c20fb7] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:54:42.718507 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-3450de55-20ea-4608-b7ee-e5d4a33f293e tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:42.719064 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-3450de55-20ea-4608-b7ee-e5d4a33f293e tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:42.719951 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-3450de55-20ea-4608-b7ee-e5d4a33f293e tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:42.720453 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-3450de55-20ea-4608-b7ee-e5d4a33f293e tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:42.868950 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-3450de55-20ea-4608-b7ee-e5d4a33f293e tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:54:42.880220 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-3450de55-20ea-4608-b7ee-e5d4a33f293e tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:54:42.882216 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-3450de55-20ea-4608-b7ee-e5d4a33f293e tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:54:42.883508 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-3450de55-20ea-4608-b7ee-e5d4a33f293e tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] 10.222.0.26 "GET /compute/v2.1/servers/e28e570d-3d50-4fe8-bb4a-fe0e95c20fb7" status: 200 len: 1750 microversion: 2.20 time: 0.196544 Mar 05 02:54:42.893455 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 182/354] 10.222.0.26 () {60 vars in 1276 bytes} [Sat Mar 5 02:54:42 2022] GET /compute/v2.1/servers/e28e570d-3d50-4fe8-bb4a-fe0e95c20fb7 => generated 1750 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 02:54:43.175847 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-97836e7e-6626-416e-b5e4-24ca70115649 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:54:43.176467 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-97836e7e-6626-416e-b5e4-24ca70115649 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] [instance: c24fee69-5bf4-40f4-ba18-56aecd12dd96] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:54:43.183174 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-97836e7e-6626-416e-b5e4-24ca70115649 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:43.183641 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-97836e7e-6626-416e-b5e4-24ca70115649 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:43.190002 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-97836e7e-6626-416e-b5e4-24ca70115649 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:43.190002 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-97836e7e-6626-416e-b5e4-24ca70115649 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:43.338089 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-97836e7e-6626-416e-b5e4-24ca70115649 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90033e5e8e634b699bf050e36519f8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8112a5759c444c1f94be24ab61bf072f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:54:43.346636 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-97836e7e-6626-416e-b5e4-24ca70115649 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] 10.222.0.26 "GET /compute/v2.1/servers/c24fee69-5bf4-40f4-ba18-56aecd12dd96" status: 200 len: 1566 microversion: 2.1 time: 0.174592 Mar 05 02:54:43.347216 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 173/355] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:54:43 2022] GET /compute/v2.1/servers/c24fee69-5bf4-40f4-ba18-56aecd12dd96 => generated 1566 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 02:54:43.635943 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-794b37c2-fbbe-4d8d-a0e7-d1bf857a4103 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:54:43.640767 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-794b37c2-fbbe-4d8d-a0e7-d1bf857a4103 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] [instance: d0080e4b-6532-4e0c-8d19-cfbdf32e401b] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:54:43.647535 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-794b37c2-fbbe-4d8d-a0e7-d1bf857a4103 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:43.648096 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-794b37c2-fbbe-4d8d-a0e7-d1bf857a4103 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:43.648967 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-794b37c2-fbbe-4d8d-a0e7-d1bf857a4103 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:43.649417 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-794b37c2-fbbe-4d8d-a0e7-d1bf857a4103 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:43.791837 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-794b37c2-fbbe-4d8d-a0e7-d1bf857a4103 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e5a000087fe40419ccd0d1a96fb4783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9d27da2e71d4962a53a95efc46518ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:54:43.801255 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-794b37c2-fbbe-4d8d-a0e7-d1bf857a4103 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] 10.222.0.26 "GET /compute/v2.1/servers/d0080e4b-6532-4e0c-8d19-cfbdf32e401b" status: 200 len: 1724 microversion: 2.1 time: 0.186731 Mar 05 02:54:43.801622 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 183/356] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:54:43 2022] GET /compute/v2.1/servers/d0080e4b-6532-4e0c-8d19-cfbdf32e401b => generated 1724 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 02:54:43.911449 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-7d9f319a-c735-4aba-8bcd-0b314f78ba14 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:54:43.912065 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-7d9f319a-c735-4aba-8bcd-0b314f78ba14 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] [instance: e28e570d-3d50-4fe8-bb4a-fe0e95c20fb7] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:54:43.917885 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-7d9f319a-c735-4aba-8bcd-0b314f78ba14 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:43.918369 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-7d9f319a-c735-4aba-8bcd-0b314f78ba14 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:43.919138 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-7d9f319a-c735-4aba-8bcd-0b314f78ba14 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:43.920111 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-7d9f319a-c735-4aba-8bcd-0b314f78ba14 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:44.069820 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-7d9f319a-c735-4aba-8bcd-0b314f78ba14 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:54:44.079462 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-7d9f319a-c735-4aba-8bcd-0b314f78ba14 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:54:44.081243 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-7d9f319a-c735-4aba-8bcd-0b314f78ba14 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:54:44.082515 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-7d9f319a-c735-4aba-8bcd-0b314f78ba14 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] 10.222.0.26 "GET /compute/v2.1/servers/e28e570d-3d50-4fe8-bb4a-fe0e95c20fb7" status: 200 len: 1750 microversion: 2.20 time: 0.179917 Mar 05 02:54:44.083066 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 174/357] 10.222.0.26 () {60 vars in 1276 bytes} [Sat Mar 5 02:54:43 2022] GET /compute/v2.1/servers/e28e570d-3d50-4fe8-bb4a-fe0e95c20fb7 => generated 1750 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 02:54:44.363948 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-dd331577-71aa-4a05-be7d-585253f133b8 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:54:44.364587 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-dd331577-71aa-4a05-be7d-585253f133b8 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] [instance: c24fee69-5bf4-40f4-ba18-56aecd12dd96] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:54:44.370275 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-dd331577-71aa-4a05-be7d-585253f133b8 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:44.370726 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-dd331577-71aa-4a05-be7d-585253f133b8 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:44.371492 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-dd331577-71aa-4a05-be7d-585253f133b8 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:44.371930 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-dd331577-71aa-4a05-be7d-585253f133b8 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:44.509073 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-dd331577-71aa-4a05-be7d-585253f133b8 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90033e5e8e634b699bf050e36519f8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8112a5759c444c1f94be24ab61bf072f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:54:44.516965 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-dd331577-71aa-4a05-be7d-585253f133b8 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] 10.222.0.26 "GET /compute/v2.1/servers/c24fee69-5bf4-40f4-ba18-56aecd12dd96" status: 200 len: 1566 microversion: 2.1 time: 0.156810 Mar 05 02:54:44.517552 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 184/358] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:54:44 2022] GET /compute/v2.1/servers/c24fee69-5bf4-40f4-ba18-56aecd12dd96 => generated 1566 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 02:54:44.818746 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-829456d5-c2d3-4fc7-a0a6-ce1fbc4efbb8 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:54:44.819342 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-829456d5-c2d3-4fc7-a0a6-ce1fbc4efbb8 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] [instance: d0080e4b-6532-4e0c-8d19-cfbdf32e401b] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:54:44.825906 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-829456d5-c2d3-4fc7-a0a6-ce1fbc4efbb8 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:44.826711 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-829456d5-c2d3-4fc7-a0a6-ce1fbc4efbb8 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:44.827504 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-829456d5-c2d3-4fc7-a0a6-ce1fbc4efbb8 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:44.827958 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-829456d5-c2d3-4fc7-a0a6-ce1fbc4efbb8 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:44.958864 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-829456d5-c2d3-4fc7-a0a6-ce1fbc4efbb8 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e5a000087fe40419ccd0d1a96fb4783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9d27da2e71d4962a53a95efc46518ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:54:44.967004 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-829456d5-c2d3-4fc7-a0a6-ce1fbc4efbb8 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] 10.222.0.26 "GET /compute/v2.1/servers/d0080e4b-6532-4e0c-8d19-cfbdf32e401b" status: 200 len: 1724 microversion: 2.1 time: 0.151911 Mar 05 02:54:44.967618 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 175/359] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:54:44 2022] GET /compute/v2.1/servers/d0080e4b-6532-4e0c-8d19-cfbdf32e401b => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 02:54:45.100718 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-947aaab1-ca02-40a0-a82f-fd161a396757 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:54:45.101254 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-947aaab1-ca02-40a0-a82f-fd161a396757 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] [instance: e28e570d-3d50-4fe8-bb4a-fe0e95c20fb7] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:54:45.107819 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-947aaab1-ca02-40a0-a82f-fd161a396757 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:45.108264 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-947aaab1-ca02-40a0-a82f-fd161a396757 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:45.109021 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-947aaab1-ca02-40a0-a82f-fd161a396757 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:45.109454 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-947aaab1-ca02-40a0-a82f-fd161a396757 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:45.241692 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-947aaab1-ca02-40a0-a82f-fd161a396757 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:54:45.251925 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-947aaab1-ca02-40a0-a82f-fd161a396757 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:54:45.253498 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-947aaab1-ca02-40a0-a82f-fd161a396757 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:54:45.254917 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-947aaab1-ca02-40a0-a82f-fd161a396757 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] 10.222.0.26 "GET /compute/v2.1/servers/e28e570d-3d50-4fe8-bb4a-fe0e95c20fb7" status: 200 len: 1750 microversion: 2.20 time: 0.158139 Mar 05 02:54:45.255603 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 185/360] 10.222.0.26 () {60 vars in 1276 bytes} [Sat Mar 5 02:54:45 2022] GET /compute/v2.1/servers/e28e570d-3d50-4fe8-bb4a-fe0e95c20fb7 => generated 1750 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 02:54:45.534360 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-c8f1086d-0aaf-4458-a839-8be21244529c tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:54:45.535023 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-c8f1086d-0aaf-4458-a839-8be21244529c tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] [instance: c24fee69-5bf4-40f4-ba18-56aecd12dd96] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:54:45.541537 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-c8f1086d-0aaf-4458-a839-8be21244529c tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:45.541934 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-c8f1086d-0aaf-4458-a839-8be21244529c tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:45.542829 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-c8f1086d-0aaf-4458-a839-8be21244529c tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:45.543297 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-c8f1086d-0aaf-4458-a839-8be21244529c tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:45.677641 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-c8f1086d-0aaf-4458-a839-8be21244529c tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90033e5e8e634b699bf050e36519f8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8112a5759c444c1f94be24ab61bf072f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:54:45.685899 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-c8f1086d-0aaf-4458-a839-8be21244529c tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] 10.222.0.26 "GET /compute/v2.1/servers/c24fee69-5bf4-40f4-ba18-56aecd12dd96" status: 200 len: 1566 microversion: 2.1 time: 0.155450 Mar 05 02:54:45.686450 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 176/361] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:54:45 2022] GET /compute/v2.1/servers/c24fee69-5bf4-40f4-ba18-56aecd12dd96 => generated 1566 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 02:54:45.984694 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-3c6b277e-2159-45c5-844a-d17cf12bb38f tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:54:45.985274 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-3c6b277e-2159-45c5-844a-d17cf12bb38f tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] [instance: d0080e4b-6532-4e0c-8d19-cfbdf32e401b] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:54:45.991108 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-3c6b277e-2159-45c5-844a-d17cf12bb38f tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:45.991563 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-3c6b277e-2159-45c5-844a-d17cf12bb38f tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:45.992337 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-3c6b277e-2159-45c5-844a-d17cf12bb38f tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:45.992770 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-3c6b277e-2159-45c5-844a-d17cf12bb38f tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:46.125800 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-3c6b277e-2159-45c5-844a-d17cf12bb38f tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e5a000087fe40419ccd0d1a96fb4783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9d27da2e71d4962a53a95efc46518ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:54:46.133494 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-3c6b277e-2159-45c5-844a-d17cf12bb38f tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] 10.222.0.26 "GET /compute/v2.1/servers/d0080e4b-6532-4e0c-8d19-cfbdf32e401b" status: 200 len: 1701 microversion: 2.1 time: 0.153229 Mar 05 02:54:46.134085 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 186/362] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:54:45 2022] GET /compute/v2.1/servers/d0080e4b-6532-4e0c-8d19-cfbdf32e401b => generated 1701 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 02:54:46.149642 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-91351c4c-dd67-4064-9523-99e998bc648b tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 02:54:46.157017 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-91351c4c-dd67-4064-9523-99e998bc648b tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:46.157470 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-91351c4c-dd67-4064-9523-99e998bc648b tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:46.179964 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-91351c4c-dd67-4064-9523-99e998bc648b tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] [instance: d0080e4b-6532-4e0c-8d19-cfbdf32e401b] Going to try to start instance {{(pid=123546) start /opt/stack/nova/nova/compute/api.py:2730}} Mar 05 02:54:46.220973 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-91351c4c-dd67-4064-9523-99e998bc648b tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] 10.222.0.26 "POST /compute/v2.1/servers/d0080e4b-6532-4e0c-8d19-cfbdf32e401b/action" status: 202 len: 0 microversion: 2.1 time: 0.075012 Mar 05 02:54:46.221725 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 177/363] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Mar 5 02:54:46 2022] POST /compute/v2.1/servers/d0080e4b-6532-4e0c-8d19-cfbdf32e401b/action => generated 0 bytes in 77 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Mar 05 02:54:46.230048 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-6bf9c4cb-67e9-478e-9ef7-f1d397868f2f tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:54:46.230658 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-6bf9c4cb-67e9-478e-9ef7-f1d397868f2f tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] [instance: d0080e4b-6532-4e0c-8d19-cfbdf32e401b] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:54:46.237095 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-6bf9c4cb-67e9-478e-9ef7-f1d397868f2f tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:46.237527 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-6bf9c4cb-67e9-478e-9ef7-f1d397868f2f tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:46.238327 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-6bf9c4cb-67e9-478e-9ef7-f1d397868f2f tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:46.238764 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-6bf9c4cb-67e9-478e-9ef7-f1d397868f2f tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:46.280011 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-07992715-aa92-41ad-a377-2e0916a530f9 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:54:46.281751 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-07992715-aa92-41ad-a377-2e0916a530f9 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] [instance: e28e570d-3d50-4fe8-bb4a-fe0e95c20fb7] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:54:46.288688 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-07992715-aa92-41ad-a377-2e0916a530f9 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:46.289567 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-07992715-aa92-41ad-a377-2e0916a530f9 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:46.290570 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-07992715-aa92-41ad-a377-2e0916a530f9 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:46.291011 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-07992715-aa92-41ad-a377-2e0916a530f9 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:46.528155 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-6bf9c4cb-67e9-478e-9ef7-f1d397868f2f tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e5a000087fe40419ccd0d1a96fb4783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9d27da2e71d4962a53a95efc46518ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:54:46.539601 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-6bf9c4cb-67e9-478e-9ef7-f1d397868f2f tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] 10.222.0.26 "GET /compute/v2.1/servers/d0080e4b-6532-4e0c-8d19-cfbdf32e401b" status: 200 len: 1710 microversion: 2.1 time: 0.313353 Mar 05 02:54:46.540195 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 187/364] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:54:46 2022] GET /compute/v2.1/servers/d0080e4b-6532-4e0c-8d19-cfbdf32e401b => generated 1710 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 02:54:46.598891 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-07992715-aa92-41ad-a377-2e0916a530f9 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:54:46.609106 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-07992715-aa92-41ad-a377-2e0916a530f9 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:54:46.610854 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-07992715-aa92-41ad-a377-2e0916a530f9 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:54:46.612327 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-07992715-aa92-41ad-a377-2e0916a530f9 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] 10.222.0.26 "GET /compute/v2.1/servers/e28e570d-3d50-4fe8-bb4a-fe0e95c20fb7" status: 200 len: 1752 microversion: 2.20 time: 0.340845 Mar 05 02:54:46.613394 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 178/365] 10.222.0.26 () {60 vars in 1276 bytes} [Sat Mar 5 02:54:46 2022] GET /compute/v2.1/servers/e28e570d-3d50-4fe8-bb4a-fe0e95c20fb7 => generated 1752 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 02:54:46.703288 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-a21639ba-3e52-445f-8918-240f9242b753 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:54:46.704706 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-a21639ba-3e52-445f-8918-240f9242b753 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] [instance: c24fee69-5bf4-40f4-ba18-56aecd12dd96] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:54:46.712840 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-a21639ba-3e52-445f-8918-240f9242b753 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:46.712998 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-a21639ba-3e52-445f-8918-240f9242b753 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:46.713864 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-a21639ba-3e52-445f-8918-240f9242b753 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:46.714602 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-a21639ba-3e52-445f-8918-240f9242b753 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:47.016561 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-a21639ba-3e52-445f-8918-240f9242b753 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90033e5e8e634b699bf050e36519f8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8112a5759c444c1f94be24ab61bf072f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:54:47.029791 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-a21639ba-3e52-445f-8918-240f9242b753 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] 10.222.0.26 "GET /compute/v2.1/servers/c24fee69-5bf4-40f4-ba18-56aecd12dd96" status: 200 len: 1566 microversion: 2.1 time: 0.330859 Mar 05 02:54:47.032994 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 188/366] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:54:46 2022] GET /compute/v2.1/servers/c24fee69-5bf4-40f4-ba18-56aecd12dd96 => generated 1566 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 02:54:47.559950 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-a0c4af6a-9d25-40e7-bf73-449a01b6179d tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:54:47.561253 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-a0c4af6a-9d25-40e7-bf73-449a01b6179d tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] [instance: d0080e4b-6532-4e0c-8d19-cfbdf32e401b] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:54:47.569206 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-a0c4af6a-9d25-40e7-bf73-449a01b6179d tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:47.569750 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-a0c4af6a-9d25-40e7-bf73-449a01b6179d tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:47.570752 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-a0c4af6a-9d25-40e7-bf73-449a01b6179d tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:47.571263 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-a0c4af6a-9d25-40e7-bf73-449a01b6179d tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:47.660234 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-711a07d2-5f2f-4f5e-b8fe-295dfdb4a4aa tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:54:47.662208 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-711a07d2-5f2f-4f5e-b8fe-295dfdb4a4aa tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] [instance: e28e570d-3d50-4fe8-bb4a-fe0e95c20fb7] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:54:47.676359 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-711a07d2-5f2f-4f5e-b8fe-295dfdb4a4aa tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:47.678033 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-711a07d2-5f2f-4f5e-b8fe-295dfdb4a4aa tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:47.679881 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-711a07d2-5f2f-4f5e-b8fe-295dfdb4a4aa tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:47.690340 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-711a07d2-5f2f-4f5e-b8fe-295dfdb4a4aa tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:48.039494 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-a0c4af6a-9d25-40e7-bf73-449a01b6179d tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e5a000087fe40419ccd0d1a96fb4783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9d27da2e71d4962a53a95efc46518ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:54:48.051913 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-a0c4af6a-9d25-40e7-bf73-449a01b6179d tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] 10.222.0.26 "GET /compute/v2.1/servers/d0080e4b-6532-4e0c-8d19-cfbdf32e401b" status: 200 len: 1710 microversion: 2.1 time: 0.495882 Mar 05 02:54:48.053278 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 179/367] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:54:47 2022] GET /compute/v2.1/servers/d0080e4b-6532-4e0c-8d19-cfbdf32e401b => generated 1710 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 02:54:48.058757 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-570a212a-81de-455a-b82f-9a071689e6c6 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:54:48.059796 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-570a212a-81de-455a-b82f-9a071689e6c6 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] [instance: c24fee69-5bf4-40f4-ba18-56aecd12dd96] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:54:48.067412 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-570a212a-81de-455a-b82f-9a071689e6c6 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:48.068101 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-570a212a-81de-455a-b82f-9a071689e6c6 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:48.069065 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-570a212a-81de-455a-b82f-9a071689e6c6 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:48.069501 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-570a212a-81de-455a-b82f-9a071689e6c6 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:48.187622 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-711a07d2-5f2f-4f5e-b8fe-295dfdb4a4aa tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:54:48.195817 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-711a07d2-5f2f-4f5e-b8fe-295dfdb4a4aa tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:54:48.197301 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-711a07d2-5f2f-4f5e-b8fe-295dfdb4a4aa tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:54:48.198479 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-711a07d2-5f2f-4f5e-b8fe-295dfdb4a4aa tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] 10.222.0.26 "GET /compute/v2.1/servers/e28e570d-3d50-4fe8-bb4a-fe0e95c20fb7" status: 200 len: 1808 microversion: 2.20 time: 0.559511 Mar 05 02:54:48.199041 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 189/368] 10.222.0.26 () {60 vars in 1276 bytes} [Sat Mar 5 02:54:47 2022] GET /compute/v2.1/servers/e28e570d-3d50-4fe8-bb4a-fe0e95c20fb7 => generated 1808 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 02:54:48.305110 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-570a212a-81de-455a-b82f-9a071689e6c6 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90033e5e8e634b699bf050e36519f8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8112a5759c444c1f94be24ab61bf072f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:54:48.318908 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-570a212a-81de-455a-b82f-9a071689e6c6 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] 10.222.0.26 "GET /compute/v2.1/servers/c24fee69-5bf4-40f4-ba18-56aecd12dd96" status: 200 len: 1566 microversion: 2.1 time: 0.263990 Mar 05 02:54:48.320281 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 180/369] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:54:48 2022] GET /compute/v2.1/servers/c24fee69-5bf4-40f4-ba18-56aecd12dd96 => generated 1566 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 02:54:49.076145 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-77f9130b-6824-4769-bfdb-fec374948d81 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:54:49.077684 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-77f9130b-6824-4769-bfdb-fec374948d81 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] [instance: d0080e4b-6532-4e0c-8d19-cfbdf32e401b] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:54:49.086134 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-77f9130b-6824-4769-bfdb-fec374948d81 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:49.086678 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-77f9130b-6824-4769-bfdb-fec374948d81 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:49.087734 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-77f9130b-6824-4769-bfdb-fec374948d81 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:49.088255 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-77f9130b-6824-4769-bfdb-fec374948d81 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:49.228889 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-2b2b0ce5-e8d2-4440-ac3c-2220d40c331f tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:54:49.231249 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-2b2b0ce5-e8d2-4440-ac3c-2220d40c331f tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] [instance: e28e570d-3d50-4fe8-bb4a-fe0e95c20fb7] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:54:49.249411 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-2b2b0ce5-e8d2-4440-ac3c-2220d40c331f tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:49.250210 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-2b2b0ce5-e8d2-4440-ac3c-2220d40c331f tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:49.250938 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-2b2b0ce5-e8d2-4440-ac3c-2220d40c331f tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:49.253595 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-2b2b0ce5-e8d2-4440-ac3c-2220d40c331f tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:49.257250 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-77f9130b-6824-4769-bfdb-fec374948d81 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e5a000087fe40419ccd0d1a96fb4783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9d27da2e71d4962a53a95efc46518ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:54:49.267417 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-77f9130b-6824-4769-bfdb-fec374948d81 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] 10.222.0.26 "GET /compute/v2.1/servers/d0080e4b-6532-4e0c-8d19-cfbdf32e401b" status: 200 len: 1714 microversion: 2.1 time: 0.196749 Mar 05 02:54:49.268600 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 190/370] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:54:49 2022] GET /compute/v2.1/servers/d0080e4b-6532-4e0c-8d19-cfbdf32e401b => generated 1714 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 02:54:49.336612 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-360da45c-eba3-4d35-b4ce-a79a15c6c8d8 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:54:49.337034 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-360da45c-eba3-4d35-b4ce-a79a15c6c8d8 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] [instance: c24fee69-5bf4-40f4-ba18-56aecd12dd96] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:54:49.342961 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-360da45c-eba3-4d35-b4ce-a79a15c6c8d8 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:49.343406 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-360da45c-eba3-4d35-b4ce-a79a15c6c8d8 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:49.344171 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-360da45c-eba3-4d35-b4ce-a79a15c6c8d8 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:49.344778 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-360da45c-eba3-4d35-b4ce-a79a15c6c8d8 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:49.470618 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-2b2b0ce5-e8d2-4440-ac3c-2220d40c331f tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:54:49.479550 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-2b2b0ce5-e8d2-4440-ac3c-2220d40c331f tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:54:49.481184 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-2b2b0ce5-e8d2-4440-ac3c-2220d40c331f tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:54:49.482647 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-2b2b0ce5-e8d2-4440-ac3c-2220d40c331f tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] 10.222.0.26 "GET /compute/v2.1/servers/e28e570d-3d50-4fe8-bb4a-fe0e95c20fb7" status: 200 len: 1808 microversion: 2.20 time: 0.265388 Mar 05 02:54:49.494210 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 181/371] 10.222.0.26 () {60 vars in 1276 bytes} [Sat Mar 5 02:54:49 2022] GET /compute/v2.1/servers/e28e570d-3d50-4fe8-bb4a-fe0e95c20fb7 => generated 1808 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 02:54:49.549044 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-360da45c-eba3-4d35-b4ce-a79a15c6c8d8 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90033e5e8e634b699bf050e36519f8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8112a5759c444c1f94be24ab61bf072f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:54:49.556781 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-360da45c-eba3-4d35-b4ce-a79a15c6c8d8 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] 10.222.0.26 "GET /compute/v2.1/servers/c24fee69-5bf4-40f4-ba18-56aecd12dd96" status: 200 len: 1566 microversion: 2.1 time: 0.224270 Mar 05 02:54:49.558277 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 191/372] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:54:49 2022] GET /compute/v2.1/servers/c24fee69-5bf4-40f4-ba18-56aecd12dd96 => generated 1566 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 02:54:50.501328 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-4ee12ef8-5742-4bf7-9d50-505b7bd46947 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:54:50.501975 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-4ee12ef8-5742-4bf7-9d50-505b7bd46947 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] [instance: e28e570d-3d50-4fe8-bb4a-fe0e95c20fb7] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:54:50.509727 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-4ee12ef8-5742-4bf7-9d50-505b7bd46947 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:50.510342 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-4ee12ef8-5742-4bf7-9d50-505b7bd46947 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:50.511425 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-4ee12ef8-5742-4bf7-9d50-505b7bd46947 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:50.511981 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-4ee12ef8-5742-4bf7-9d50-505b7bd46947 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:50.574252 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-f58ebae4-9b32-4c38-b669-4ad17b8c8d70 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:54:50.575197 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-f58ebae4-9b32-4c38-b669-4ad17b8c8d70 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] [instance: c24fee69-5bf4-40f4-ba18-56aecd12dd96] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:54:50.582670 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-f58ebae4-9b32-4c38-b669-4ad17b8c8d70 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:50.583135 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-f58ebae4-9b32-4c38-b669-4ad17b8c8d70 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:50.583912 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-f58ebae4-9b32-4c38-b669-4ad17b8c8d70 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:50.584352 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-f58ebae4-9b32-4c38-b669-4ad17b8c8d70 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:50.693037 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-4ee12ef8-5742-4bf7-9d50-505b7bd46947 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:54:50.703995 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-4ee12ef8-5742-4bf7-9d50-505b7bd46947 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:54:50.705761 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-4ee12ef8-5742-4bf7-9d50-505b7bd46947 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:54:50.707545 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-4ee12ef8-5742-4bf7-9d50-505b7bd46947 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] 10.222.0.26 "GET /compute/v2.1/servers/e28e570d-3d50-4fe8-bb4a-fe0e95c20fb7" status: 200 len: 1808 microversion: 2.20 time: 0.210327 Mar 05 02:54:50.719392 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 182/373] 10.222.0.26 () {60 vars in 1276 bytes} [Sat Mar 5 02:54:50 2022] GET /compute/v2.1/servers/e28e570d-3d50-4fe8-bb4a-fe0e95c20fb7 => generated 1808 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 02:54:50.777169 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-f58ebae4-9b32-4c38-b669-4ad17b8c8d70 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90033e5e8e634b699bf050e36519f8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8112a5759c444c1f94be24ab61bf072f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:54:50.788159 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-f58ebae4-9b32-4c38-b669-4ad17b8c8d70 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] 10.222.0.26 "GET /compute/v2.1/servers/c24fee69-5bf4-40f4-ba18-56aecd12dd96" status: 200 len: 1566 microversion: 2.1 time: 0.217709 Mar 05 02:54:50.794107 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 192/374] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:54:50 2022] GET /compute/v2.1/servers/c24fee69-5bf4-40f4-ba18-56aecd12dd96 => generated 1566 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 02:54:51.103469 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-aab31c65-f870-43d6-926f-9d0434e6b6bc tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1795097586", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-320980881", "security_groups": [{"name": "tempest-secgroup-smoke-1936346101"}], "networks": [{"uuid": "6abb402c-01c2-48bf-88c5-8d2968bf132e"}], "block_device_mapping_v2": [{"uuid": "effaee9f-01d9-43ea-b924-80ff25af9669", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 02:54:51.309347 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.network.neutron [None req-aab31c65-f870-43d6-926f-9d0434e6b6bc tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] validate_networks() for [('6abb402c-01c2-48bf-88c5-8d2968bf132e', None, None, None, None, None)] {{(pid=123546) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 05 02:54:51.774662 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-e02c8625-d798-4f8b-98eb-ce838aadb96f tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:54:51.774662 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-e02c8625-d798-4f8b-98eb-ce838aadb96f tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] [instance: e28e570d-3d50-4fe8-bb4a-fe0e95c20fb7] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:54:51.774662 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-e02c8625-d798-4f8b-98eb-ce838aadb96f tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:51.774662 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-e02c8625-d798-4f8b-98eb-ce838aadb96f tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:51.775321 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-e02c8625-d798-4f8b-98eb-ce838aadb96f tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:51.788421 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-e02c8625-d798-4f8b-98eb-ce838aadb96f tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:52.128132 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.virt.hardware [None req-aab31c65-f870-43d6-926f-9d0434e6b6bc tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] Flavor limits 0:0:0 {{(pid=123546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 05 02:54:52.128738 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.virt.hardware [None req-aab31c65-f870-43d6-926f-9d0434e6b6bc tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] Image limits 0:0:0 {{(pid=123546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 05 02:54:52.129021 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.virt.hardware [None req-aab31c65-f870-43d6-926f-9d0434e6b6bc tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] Flavor pref 0:0:0 {{(pid=123546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 05 02:54:52.129536 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.virt.hardware [None req-aab31c65-f870-43d6-926f-9d0434e6b6bc tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] Image pref 0:0:0 {{(pid=123546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 05 02:54:52.130213 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.virt.hardware [None req-aab31c65-f870-43d6-926f-9d0434e6b6bc tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 05 02:54:52.149483 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-aab31c65-f870-43d6-926f-9d0434e6b6bc tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:52.150000 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-aab31c65-f870-43d6-926f-9d0434e6b6bc tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:52.150951 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-aab31c65-f870-43d6-926f-9d0434e6b6bc tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:52.151402 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-aab31c65-f870-43d6-926f-9d0434e6b6bc tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:52.172357 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-e02c8625-d798-4f8b-98eb-ce838aadb96f tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:54:52.183947 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.quota [None req-aab31c65-f870-43d6-926f-9d0434e6b6bc tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] Getting quotas for project 47835ba5de1a42cc94c09b33a187868a. Resources: {'ram', 'cores', 'instances'} {{(pid=123546) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 02:54:52.188115 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-e02c8625-d798-4f8b-98eb-ce838aadb96f tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:54:52.189866 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.quota [None req-aab31c65-f870-43d6-926f-9d0434e6b6bc tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] Getting quotas for user 4c68b816379942e282577e3d8d624ae1 and project 47835ba5de1a42cc94c09b33a187868a. Resources: {'ram', 'cores', 'instances'} {{(pid=123546) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 02:54:52.203711 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-e02c8625-d798-4f8b-98eb-ce838aadb96f tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:54:52.205984 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-e02c8625-d798-4f8b-98eb-ce838aadb96f tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] 10.222.0.26 "GET /compute/v2.1/servers/e28e570d-3d50-4fe8-bb4a-fe0e95c20fb7" status: 200 len: 1808 microversion: 2.20 time: 0.474563 Mar 05 02:54:52.207075 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 193/375] 10.222.0.26 () {60 vars in 1276 bytes} [Sat Mar 5 02:54:51 2022] GET /compute/v2.1/servers/e28e570d-3d50-4fe8-bb4a-fe0e95c20fb7 => generated 1808 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 02:54:52.215130 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-3d174a4a-f726-4c29-abb1-c730c546b679 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:54:52.218245 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-3d174a4a-f726-4c29-abb1-c730c546b679 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] [instance: c24fee69-5bf4-40f4-ba18-56aecd12dd96] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:54:52.233263 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-3d174a4a-f726-4c29-abb1-c730c546b679 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:52.234548 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-3d174a4a-f726-4c29-abb1-c730c546b679 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:52.236165 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-3d174a4a-f726-4c29-abb1-c730c546b679 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:52.237192 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-3d174a4a-f726-4c29-abb1-c730c546b679 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:52.287230 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-aab31c65-f870-43d6-926f-9d0434e6b6bc tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] Going to run 1 instances... {{(pid=123546) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 05 02:54:52.289298 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-aab31c65-f870-43d6-926f-9d0434e6b6bc tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] [instance: ca6cb405-f00a-4fcf-9147-824793f35ebf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='effaee9f-01d9-43ea-b924-80ff25af9669',volume_size=None,volume_type=None)] {{(pid=123546) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 05 02:54:52.494624 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-aab31c65-f870-43d6-926f-9d0434e6b6bc tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.397807 Mar 05 02:54:52.495774 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 183/376] 10.222.0.26 () {60 vars in 1146 bytes} [Sat Mar 5 02:54:51 2022] POST /compute/v2.1/servers => generated 406 bytes in 1400 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 05 02:54:52.503235 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-3d174a4a-f726-4c29-abb1-c730c546b679 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90033e5e8e634b699bf050e36519f8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8112a5759c444c1f94be24ab61bf072f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:54:52.506017 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-edc08602-d1f6-42ee-81dc-733fd43f54fa tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:54:52.507050 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-edc08602-d1f6-42ee-81dc-733fd43f54fa tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] [instance: ca6cb405-f00a-4fcf-9147-824793f35ebf] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:54:52.516452 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-3d174a4a-f726-4c29-abb1-c730c546b679 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] 10.222.0.26 "GET /compute/v2.1/servers/c24fee69-5bf4-40f4-ba18-56aecd12dd96" status: 200 len: 1566 microversion: 2.1 time: 0.307658 Mar 05 02:54:52.517031 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 194/377] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:54:52 2022] GET /compute/v2.1/servers/c24fee69-5bf4-40f4-ba18-56aecd12dd96 => generated 1566 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 02:54:52.613443 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-edc08602-d1f6-42ee-81dc-733fd43f54fa tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c68b816379942e282577e3d8d624ae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47835ba5de1a42cc94c09b33a187868a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:54:52.629788 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-edc08602-d1f6-42ee-81dc-733fd43f54fa tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] 10.222.0.26 "GET /compute/v2.1/servers/ca6cb405-f00a-4fcf-9147-824793f35ebf" status: 200 len: 1088 microversion: 2.1 time: 0.128061 Mar 05 02:54:52.644289 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 184/378] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:54:52 2022] GET /compute/v2.1/servers/ca6cb405-f00a-4fcf-9147-824793f35ebf => generated 1088 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 02:54:53.226692 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-d2c07833-71ad-474b-87a5-9d8a36bc46e3 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:54:53.227426 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-d2c07833-71ad-474b-87a5-9d8a36bc46e3 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] [instance: e28e570d-3d50-4fe8-bb4a-fe0e95c20fb7] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:54:53.248079 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-d2c07833-71ad-474b-87a5-9d8a36bc46e3 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:53.248862 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-d2c07833-71ad-474b-87a5-9d8a36bc46e3 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:53.250307 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-d2c07833-71ad-474b-87a5-9d8a36bc46e3 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:53.250897 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-d2c07833-71ad-474b-87a5-9d8a36bc46e3 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:53.494527 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-d2c07833-71ad-474b-87a5-9d8a36bc46e3 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:54:53.511200 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-d2c07833-71ad-474b-87a5-9d8a36bc46e3 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:54:53.516043 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-d2c07833-71ad-474b-87a5-9d8a36bc46e3 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:54:53.540658 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-3d14edd5-abdd-44d1-870c-9489074fdd76 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:54:53.542119 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-3d14edd5-abdd-44d1-870c-9489074fdd76 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] [instance: c24fee69-5bf4-40f4-ba18-56aecd12dd96] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:54:53.547037 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-d2c07833-71ad-474b-87a5-9d8a36bc46e3 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] 10.222.0.26 "GET /compute/v2.1/servers/e28e570d-3d50-4fe8-bb4a-fe0e95c20fb7" status: 200 len: 1808 microversion: 2.20 time: 0.325345 Mar 05 02:54:53.560863 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 195/379] 10.222.0.26 () {60 vars in 1276 bytes} [Sat Mar 5 02:54:53 2022] GET /compute/v2.1/servers/e28e570d-3d50-4fe8-bb4a-fe0e95c20fb7 => generated 1808 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 02:54:53.562945 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-3d14edd5-abdd-44d1-870c-9489074fdd76 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:53.564025 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-3d14edd5-abdd-44d1-870c-9489074fdd76 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:53.573797 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-3d14edd5-abdd-44d1-870c-9489074fdd76 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:53.574610 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-3d14edd5-abdd-44d1-870c-9489074fdd76 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:53.658729 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-988f21f7-301f-41d6-9e24-9846c2686eac tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:54:53.660338 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-988f21f7-301f-41d6-9e24-9846c2686eac tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] [instance: ca6cb405-f00a-4fcf-9147-824793f35ebf] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:54:53.700606 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-988f21f7-301f-41d6-9e24-9846c2686eac tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:53.702606 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-988f21f7-301f-41d6-9e24-9846c2686eac tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:53.703621 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-988f21f7-301f-41d6-9e24-9846c2686eac tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:53.704108 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-988f21f7-301f-41d6-9e24-9846c2686eac tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:53.834007 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-988f21f7-301f-41d6-9e24-9846c2686eac tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c68b816379942e282577e3d8d624ae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47835ba5de1a42cc94c09b33a187868a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:54:53.845728 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-988f21f7-301f-41d6-9e24-9846c2686eac tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] 10.222.0.26 "GET /compute/v2.1/servers/ca6cb405-f00a-4fcf-9147-824793f35ebf" status: 200 len: 1138 microversion: 2.1 time: 0.200362 Mar 05 02:54:53.861497 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 196/380] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:54:53 2022] GET /compute/v2.1/servers/ca6cb405-f00a-4fcf-9147-824793f35ebf => generated 1138 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 02:54:53.950728 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-3d14edd5-abdd-44d1-870c-9489074fdd76 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90033e5e8e634b699bf050e36519f8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8112a5759c444c1f94be24ab61bf072f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:54:53.959573 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-3d14edd5-abdd-44d1-870c-9489074fdd76 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] 10.222.0.26 "GET /compute/v2.1/servers/c24fee69-5bf4-40f4-ba18-56aecd12dd96" status: 200 len: 1566 microversion: 2.1 time: 0.423633 Mar 05 02:54:53.971755 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 185/381] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:54:53 2022] GET /compute/v2.1/servers/c24fee69-5bf4-40f4-ba18-56aecd12dd96 => generated 1566 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 02:54:54.583900 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-9bcea817-fd2f-4b9f-b497-879aad4a04cb tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:54:54.585128 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-9bcea817-fd2f-4b9f-b497-879aad4a04cb tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] [instance: e28e570d-3d50-4fe8-bb4a-fe0e95c20fb7] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:54:54.602763 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-9bcea817-fd2f-4b9f-b497-879aad4a04cb tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:54.606540 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-9bcea817-fd2f-4b9f-b497-879aad4a04cb tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:54.609217 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-9bcea817-fd2f-4b9f-b497-879aad4a04cb tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:54.610867 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-9bcea817-fd2f-4b9f-b497-879aad4a04cb tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:54.866862 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-23c56ba8-c18e-4bae-8580-df0982b7d783 tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:54:54.867578 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-23c56ba8-c18e-4bae-8580-df0982b7d783 tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] [instance: ca6cb405-f00a-4fcf-9147-824793f35ebf] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:54:54.879512 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-23c56ba8-c18e-4bae-8580-df0982b7d783 tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:54.891252 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-23c56ba8-c18e-4bae-8580-df0982b7d783 tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:54.894548 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-23c56ba8-c18e-4bae-8580-df0982b7d783 tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:54.900362 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-9bcea817-fd2f-4b9f-b497-879aad4a04cb tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:54:54.901209 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-23c56ba8-c18e-4bae-8580-df0982b7d783 tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:54.913152 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-9bcea817-fd2f-4b9f-b497-879aad4a04cb tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:54:54.914841 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-9bcea817-fd2f-4b9f-b497-879aad4a04cb tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:54:54.916577 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-9bcea817-fd2f-4b9f-b497-879aad4a04cb tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] 10.222.0.26 "GET /compute/v2.1/servers/e28e570d-3d50-4fe8-bb4a-fe0e95c20fb7" status: 200 len: 1808 microversion: 2.20 time: 0.337313 Mar 05 02:54:54.917715 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 197/382] 10.222.0.26 () {60 vars in 1276 bytes} [Sat Mar 5 02:54:54 2022] GET /compute/v2.1/servers/e28e570d-3d50-4fe8-bb4a-fe0e95c20fb7 => generated 1808 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 02:54:54.980852 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-444044a2-f779-430c-8c8c-4951488da180 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:54:54.980852 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-444044a2-f779-430c-8c8c-4951488da180 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] [instance: c24fee69-5bf4-40f4-ba18-56aecd12dd96] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:54:55.002438 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-444044a2-f779-430c-8c8c-4951488da180 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:55.003250 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-444044a2-f779-430c-8c8c-4951488da180 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:55.006527 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-23c56ba8-c18e-4bae-8580-df0982b7d783 tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c68b816379942e282577e3d8d624ae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47835ba5de1a42cc94c09b33a187868a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:54:55.007804 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-444044a2-f779-430c-8c8c-4951488da180 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:55.008514 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-444044a2-f779-430c-8c8c-4951488da180 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:55.015839 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-23c56ba8-c18e-4bae-8580-df0982b7d783 tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] 10.222.0.26 "GET /compute/v2.1/servers/ca6cb405-f00a-4fcf-9147-824793f35ebf" status: 200 len: 1138 microversion: 2.1 time: 0.154448 Mar 05 02:54:55.017111 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 186/383] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:54:54 2022] GET /compute/v2.1/servers/ca6cb405-f00a-4fcf-9147-824793f35ebf => generated 1138 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 02:54:55.199363 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-444044a2-f779-430c-8c8c-4951488da180 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90033e5e8e634b699bf050e36519f8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8112a5759c444c1f94be24ab61bf072f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:54:55.210270 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-444044a2-f779-430c-8c8c-4951488da180 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] 10.222.0.26 "GET /compute/v2.1/servers/c24fee69-5bf4-40f4-ba18-56aecd12dd96" status: 200 len: 1566 microversion: 2.1 time: 0.235044 Mar 05 02:54:55.221296 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 198/384] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:54:54 2022] GET /compute/v2.1/servers/c24fee69-5bf4-40f4-ba18-56aecd12dd96 => generated 1566 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 02:54:55.939228 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-57d3c79a-ad31-46c1-ab7d-039058a4fe30 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:54:55.939841 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-57d3c79a-ad31-46c1-ab7d-039058a4fe30 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] [instance: e28e570d-3d50-4fe8-bb4a-fe0e95c20fb7] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:54:55.957054 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-57d3c79a-ad31-46c1-ab7d-039058a4fe30 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:55.957488 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-57d3c79a-ad31-46c1-ab7d-039058a4fe30 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:55.958345 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-57d3c79a-ad31-46c1-ab7d-039058a4fe30 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:55.958787 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-57d3c79a-ad31-46c1-ab7d-039058a4fe30 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:56.039625 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-a7a422f9-41f2-441e-aba6-d93916851117 tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:54:56.045342 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-a7a422f9-41f2-441e-aba6-d93916851117 tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] [instance: ca6cb405-f00a-4fcf-9147-824793f35ebf] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:54:56.054888 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-a7a422f9-41f2-441e-aba6-d93916851117 tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:56.060622 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-a7a422f9-41f2-441e-aba6-d93916851117 tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:56.061571 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-a7a422f9-41f2-441e-aba6-d93916851117 tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:56.062054 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-a7a422f9-41f2-441e-aba6-d93916851117 tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:56.150781 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-a7a422f9-41f2-441e-aba6-d93916851117 tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c68b816379942e282577e3d8d624ae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47835ba5de1a42cc94c09b33a187868a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:54:56.164537 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-a7a422f9-41f2-441e-aba6-d93916851117 tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] 10.222.0.26 "GET /compute/v2.1/servers/ca6cb405-f00a-4fcf-9147-824793f35ebf" status: 200 len: 1186 microversion: 2.1 time: 0.129153 Mar 05 02:54:56.165410 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 199/385] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:54:56 2022] GET /compute/v2.1/servers/ca6cb405-f00a-4fcf-9147-824793f35ebf => generated 1186 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 02:54:56.204852 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-57d3c79a-ad31-46c1-ab7d-039058a4fe30 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:54:56.217575 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-57d3c79a-ad31-46c1-ab7d-039058a4fe30 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:54:56.219299 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-57d3c79a-ad31-46c1-ab7d-039058a4fe30 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:54:56.220618 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-57d3c79a-ad31-46c1-ab7d-039058a4fe30 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] 10.222.0.26 "GET /compute/v2.1/servers/e28e570d-3d50-4fe8-bb4a-fe0e95c20fb7" status: 200 len: 1808 microversion: 2.20 time: 0.289658 Mar 05 02:54:56.221767 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 187/386] 10.222.0.26 () {60 vars in 1276 bytes} [Sat Mar 5 02:54:55 2022] GET /compute/v2.1/servers/e28e570d-3d50-4fe8-bb4a-fe0e95c20fb7 => generated 1808 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 02:54:56.240576 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-ed7e4929-6a23-48bb-bae8-b592b6c14589 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:54:56.241211 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-ed7e4929-6a23-48bb-bae8-b592b6c14589 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] [instance: c24fee69-5bf4-40f4-ba18-56aecd12dd96] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:54:56.251645 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-ed7e4929-6a23-48bb-bae8-b592b6c14589 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:56.252089 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-ed7e4929-6a23-48bb-bae8-b592b6c14589 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:56.252936 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-ed7e4929-6a23-48bb-bae8-b592b6c14589 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:56.253295 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-ed7e4929-6a23-48bb-bae8-b592b6c14589 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:56.466850 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-ed7e4929-6a23-48bb-bae8-b592b6c14589 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90033e5e8e634b699bf050e36519f8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8112a5759c444c1f94be24ab61bf072f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:54:56.477270 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-ed7e4929-6a23-48bb-bae8-b592b6c14589 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] 10.222.0.26 "GET /compute/v2.1/servers/c24fee69-5bf4-40f4-ba18-56aecd12dd96" status: 200 len: 1566 microversion: 2.1 time: 0.242854 Mar 05 02:54:56.487856 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 200/387] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:54:56 2022] GET /compute/v2.1/servers/c24fee69-5bf4-40f4-ba18-56aecd12dd96 => generated 1566 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 02:54:57.184453 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-a2b7a25f-ed59-4c99-b0c3-586a3f9fdde9 tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:54:57.185628 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-a2b7a25f-ed59-4c99-b0c3-586a3f9fdde9 tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] [instance: ca6cb405-f00a-4fcf-9147-824793f35ebf] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:54:57.207980 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-a2b7a25f-ed59-4c99-b0c3-586a3f9fdde9 tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:57.209606 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-a2b7a25f-ed59-4c99-b0c3-586a3f9fdde9 tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:57.209606 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-a2b7a25f-ed59-4c99-b0c3-586a3f9fdde9 tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:57.209606 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-a2b7a25f-ed59-4c99-b0c3-586a3f9fdde9 tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:57.245455 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-f49f8f96-a617-4363-9ec7-396ae3423354 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:54:57.247689 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-f49f8f96-a617-4363-9ec7-396ae3423354 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] [instance: e28e570d-3d50-4fe8-bb4a-fe0e95c20fb7] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:54:57.280538 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-f49f8f96-a617-4363-9ec7-396ae3423354 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:57.282572 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-f49f8f96-a617-4363-9ec7-396ae3423354 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:57.291330 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-f49f8f96-a617-4363-9ec7-396ae3423354 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:57.298660 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-f49f8f96-a617-4363-9ec7-396ae3423354 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:57.461015 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-a2b7a25f-ed59-4c99-b0c3-586a3f9fdde9 tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c68b816379942e282577e3d8d624ae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47835ba5de1a42cc94c09b33a187868a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:54:57.471344 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-a2b7a25f-ed59-4c99-b0c3-586a3f9fdde9 tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] 10.222.0.26 "GET /compute/v2.1/servers/ca6cb405-f00a-4fcf-9147-824793f35ebf" status: 200 len: 1204 microversion: 2.1 time: 0.291496 Mar 05 02:54:57.472187 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 188/388] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:54:57 2022] GET /compute/v2.1/servers/ca6cb405-f00a-4fcf-9147-824793f35ebf => generated 1204 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 02:54:57.497370 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-fa935077-8807-4236-a1ea-915cb73babc6 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:54:57.498189 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-fa935077-8807-4236-a1ea-915cb73babc6 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] [instance: c24fee69-5bf4-40f4-ba18-56aecd12dd96] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:54:57.511313 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-fa935077-8807-4236-a1ea-915cb73babc6 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:57.511836 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-fa935077-8807-4236-a1ea-915cb73babc6 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:57.512683 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-fa935077-8807-4236-a1ea-915cb73babc6 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:57.513211 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-fa935077-8807-4236-a1ea-915cb73babc6 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:57.843776 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-f49f8f96-a617-4363-9ec7-396ae3423354 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:54:57.872886 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-f49f8f96-a617-4363-9ec7-396ae3423354 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:54:57.874862 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-f49f8f96-a617-4363-9ec7-396ae3423354 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:54:57.876241 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-f49f8f96-a617-4363-9ec7-396ae3423354 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] 10.222.0.26 "GET /compute/v2.1/servers/e28e570d-3d50-4fe8-bb4a-fe0e95c20fb7" status: 200 len: 1808 microversion: 2.20 time: 0.635986 Mar 05 02:54:57.878185 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 201/389] 10.222.0.26 () {60 vars in 1276 bytes} [Sat Mar 5 02:54:57 2022] GET /compute/v2.1/servers/e28e570d-3d50-4fe8-bb4a-fe0e95c20fb7 => generated 1808 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 02:54:58.025707 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-fa935077-8807-4236-a1ea-915cb73babc6 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90033e5e8e634b699bf050e36519f8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8112a5759c444c1f94be24ab61bf072f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:54:58.040342 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-fa935077-8807-4236-a1ea-915cb73babc6 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] 10.222.0.26 "GET /compute/v2.1/servers/c24fee69-5bf4-40f4-ba18-56aecd12dd96" status: 200 len: 1566 microversion: 2.1 time: 0.547610 Mar 05 02:54:58.041074 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 189/390] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:54:57 2022] GET /compute/v2.1/servers/c24fee69-5bf4-40f4-ba18-56aecd12dd96 => generated 1566 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 02:54:58.507995 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-a4872f8b-8442-4383-85c7-af7459ffc33a tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:54:58.509407 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-a4872f8b-8442-4383-85c7-af7459ffc33a tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] [instance: ca6cb405-f00a-4fcf-9147-824793f35ebf] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:54:58.534267 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-a4872f8b-8442-4383-85c7-af7459ffc33a tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:58.539242 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-a4872f8b-8442-4383-85c7-af7459ffc33a tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:58.540566 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-a4872f8b-8442-4383-85c7-af7459ffc33a tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:58.541199 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-a4872f8b-8442-4383-85c7-af7459ffc33a tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:58.897463 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-c8ef5ff3-9045-4d3e-ad65-ff5e045e3e0b tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:54:58.898463 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-c8ef5ff3-9045-4d3e-ad65-ff5e045e3e0b tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] [instance: e28e570d-3d50-4fe8-bb4a-fe0e95c20fb7] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:54:58.906293 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-c8ef5ff3-9045-4d3e-ad65-ff5e045e3e0b tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:58.906842 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-c8ef5ff3-9045-4d3e-ad65-ff5e045e3e0b tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:58.907637 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-c8ef5ff3-9045-4d3e-ad65-ff5e045e3e0b tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:58.922746 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-c8ef5ff3-9045-4d3e-ad65-ff5e045e3e0b tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:59.315559 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-a4872f8b-8442-4383-85c7-af7459ffc33a tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c68b816379942e282577e3d8d624ae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47835ba5de1a42cc94c09b33a187868a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:54:59.334434 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-a4872f8b-8442-4383-85c7-af7459ffc33a tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] 10.222.0.26 "GET /compute/v2.1/servers/ca6cb405-f00a-4fcf-9147-824793f35ebf" status: 200 len: 1260 microversion: 2.1 time: 0.843728 Mar 05 02:54:59.342642 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 202/391] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:54:58 2022] GET /compute/v2.1/servers/ca6cb405-f00a-4fcf-9147-824793f35ebf => generated 1260 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 02:54:59.351743 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-240463a1-bc1c-45cd-9f3a-95f84d0b4e4e tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:54:59.358249 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-240463a1-bc1c-45cd-9f3a-95f84d0b4e4e tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] [instance: c24fee69-5bf4-40f4-ba18-56aecd12dd96] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:54:59.370516 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-240463a1-bc1c-45cd-9f3a-95f84d0b4e4e tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:59.376788 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-240463a1-bc1c-45cd-9f3a-95f84d0b4e4e tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:59.378342 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-240463a1-bc1c-45cd-9f3a-95f84d0b4e4e tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:54:59.381426 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-240463a1-bc1c-45cd-9f3a-95f84d0b4e4e tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:54:59.523765 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-c8ef5ff3-9045-4d3e-ad65-ff5e045e3e0b tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:54:59.538409 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-c8ef5ff3-9045-4d3e-ad65-ff5e045e3e0b tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:54:59.539909 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-c8ef5ff3-9045-4d3e-ad65-ff5e045e3e0b tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:54:59.549206 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-c8ef5ff3-9045-4d3e-ad65-ff5e045e3e0b tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] 10.222.0.26 "GET /compute/v2.1/servers/e28e570d-3d50-4fe8-bb4a-fe0e95c20fb7" status: 200 len: 1808 microversion: 2.20 time: 0.656770 Mar 05 02:54:59.566083 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 190/392] 10.222.0.26 () {60 vars in 1276 bytes} [Sat Mar 5 02:54:58 2022] GET /compute/v2.1/servers/e28e570d-3d50-4fe8-bb4a-fe0e95c20fb7 => generated 1808 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 02:54:59.813378 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-240463a1-bc1c-45cd-9f3a-95f84d0b4e4e tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90033e5e8e634b699bf050e36519f8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8112a5759c444c1f94be24ab61bf072f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:54:59.832830 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-240463a1-bc1c-45cd-9f3a-95f84d0b4e4e tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] 10.222.0.26 "GET /compute/v2.1/servers/c24fee69-5bf4-40f4-ba18-56aecd12dd96" status: 200 len: 1566 microversion: 2.1 time: 0.488628 Mar 05 02:54:59.834850 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 203/393] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:54:59 2022] GET /compute/v2.1/servers/c24fee69-5bf4-40f4-ba18-56aecd12dd96 => generated 1566 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 02:55:00.025311 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [req-5455a3bd-d5e3-4b4d-88f3-5aee278ffb7f req-e3984274-0c0c-450a-8968-e516fa305028 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ca6cb405-f00a-4fcf-9147-824793f35ebf", "tag": "6c993446-3f76-4f92-94ad-2054b8a5ebfe"}]} {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 02:55:00.036879 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [req-5455a3bd-d5e3-4b4d-88f3-5aee278ffb7f req-e3984274-0c0c-450a-8968-e516fa305028 service nova] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:55:00.037726 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [req-5455a3bd-d5e3-4b4d-88f3-5aee278ffb7f req-e3984274-0c0c-450a-8968-e516fa305028 service nova] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:55:00.051502 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.compute.server_external_events [req-5455a3bd-d5e3-4b4d-88f3-5aee278ffb7f req-e3984274-0c0c-450a-8968-e516fa305028 service nova] Creating event network-changed:6c993446-3f76-4f92-94ad-2054b8a5ebfe for instance ca6cb405-f00a-4fcf-9147-824793f35ebf on hv-cinder-82725 Mar 05 02:55:00.061094 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [req-5455a3bd-d5e3-4b4d-88f3-5aee278ffb7f req-e3984274-0c0c-450a-8968-e516fa305028 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039448 Mar 05 02:55:00.062406 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 191/394] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Mar 5 02:55:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 02:55:00.362335 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-2dc8ea28-8139-4240-965a-1af918f6afe3 tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:55:00.363247 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-2dc8ea28-8139-4240-965a-1af918f6afe3 tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] [instance: ca6cb405-f00a-4fcf-9147-824793f35ebf] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:55:00.371810 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-2dc8ea28-8139-4240-965a-1af918f6afe3 tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:55:00.379619 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-2dc8ea28-8139-4240-965a-1af918f6afe3 tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:55:00.380753 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-2dc8ea28-8139-4240-965a-1af918f6afe3 tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:55:00.381361 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-2dc8ea28-8139-4240-965a-1af918f6afe3 tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:55:00.572626 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-a95fd4bc-77fc-4cc0-ba8d-27e13afa1d77 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:55:00.573508 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-a95fd4bc-77fc-4cc0-ba8d-27e13afa1d77 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] [instance: e28e570d-3d50-4fe8-bb4a-fe0e95c20fb7] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:55:00.590440 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-a95fd4bc-77fc-4cc0-ba8d-27e13afa1d77 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:55:00.591347 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-a95fd4bc-77fc-4cc0-ba8d-27e13afa1d77 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:55:00.592361 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-a95fd4bc-77fc-4cc0-ba8d-27e13afa1d77 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:55:00.592923 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-a95fd4bc-77fc-4cc0-ba8d-27e13afa1d77 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:55:00.662990 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-2dc8ea28-8139-4240-965a-1af918f6afe3 tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c68b816379942e282577e3d8d624ae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47835ba5de1a42cc94c09b33a187868a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:55:00.680228 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-2dc8ea28-8139-4240-965a-1af918f6afe3 tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] 10.222.0.26 "GET /compute/v2.1/servers/ca6cb405-f00a-4fcf-9147-824793f35ebf" status: 200 len: 1260 microversion: 2.1 time: 0.323459 Mar 05 02:55:00.690280 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 204/395] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:55:00 2022] GET /compute/v2.1/servers/ca6cb405-f00a-4fcf-9147-824793f35ebf => generated 1260 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 02:55:00.834283 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-a95fd4bc-77fc-4cc0-ba8d-27e13afa1d77 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:55:00.851132 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-b0482c8e-6b9c-45fa-88a5-edb5f7625664 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:55:00.851747 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-b0482c8e-6b9c-45fa-88a5-edb5f7625664 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] [instance: c24fee69-5bf4-40f4-ba18-56aecd12dd96] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:55:00.863908 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-a95fd4bc-77fc-4cc0-ba8d-27e13afa1d77 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:55:00.866011 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-a95fd4bc-77fc-4cc0-ba8d-27e13afa1d77 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:55:00.866823 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-b0482c8e-6b9c-45fa-88a5-edb5f7625664 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:55:00.874586 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-b0482c8e-6b9c-45fa-88a5-edb5f7625664 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:55:00.875677 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-b0482c8e-6b9c-45fa-88a5-edb5f7625664 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:55:00.877217 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-a95fd4bc-77fc-4cc0-ba8d-27e13afa1d77 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] 10.222.0.26 "GET /compute/v2.1/servers/e28e570d-3d50-4fe8-bb4a-fe0e95c20fb7" status: 200 len: 1808 microversion: 2.20 time: 0.310306 Mar 05 02:55:00.877867 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-b0482c8e-6b9c-45fa-88a5-edb5f7625664 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:55:00.880871 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 192/396] 10.222.0.26 () {60 vars in 1276 bytes} [Sat Mar 5 02:55:00 2022] GET /compute/v2.1/servers/e28e570d-3d50-4fe8-bb4a-fe0e95c20fb7 => generated 1808 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 02:55:01.242583 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-b0482c8e-6b9c-45fa-88a5-edb5f7625664 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90033e5e8e634b699bf050e36519f8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8112a5759c444c1f94be24ab61bf072f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:55:01.251342 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-b0482c8e-6b9c-45fa-88a5-edb5f7625664 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] 10.222.0.26 "GET /compute/v2.1/servers/c24fee69-5bf4-40f4-ba18-56aecd12dd96" status: 200 len: 1566 microversion: 2.1 time: 0.404627 Mar 05 02:55:01.251946 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 205/397] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:55:00 2022] GET /compute/v2.1/servers/c24fee69-5bf4-40f4-ba18-56aecd12dd96 => generated 1566 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 02:55:01.700824 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-6dbcc3bf-d44b-402b-8a4c-1fcc2f700811 tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:55:01.701717 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-6dbcc3bf-d44b-402b-8a4c-1fcc2f700811 tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] [instance: ca6cb405-f00a-4fcf-9147-824793f35ebf] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:55:01.715370 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-6dbcc3bf-d44b-402b-8a4c-1fcc2f700811 tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:55:01.724219 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-6dbcc3bf-d44b-402b-8a4c-1fcc2f700811 tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:55:01.725186 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-6dbcc3bf-d44b-402b-8a4c-1fcc2f700811 tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:55:01.727395 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-6dbcc3bf-d44b-402b-8a4c-1fcc2f700811 tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:55:01.904930 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-8a65f868-3931-4cc3-ac88-d6b433d9875d tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:55:01.909924 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-8a65f868-3931-4cc3-ac88-d6b433d9875d tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] [instance: e28e570d-3d50-4fe8-bb4a-fe0e95c20fb7] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:55:01.925559 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-8a65f868-3931-4cc3-ac88-d6b433d9875d tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:55:01.926574 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-8a65f868-3931-4cc3-ac88-d6b433d9875d tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:55:01.927590 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-8a65f868-3931-4cc3-ac88-d6b433d9875d tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:55:01.928394 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-8a65f868-3931-4cc3-ac88-d6b433d9875d tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:55:01.977041 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-6dbcc3bf-d44b-402b-8a4c-1fcc2f700811 tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c68b816379942e282577e3d8d624ae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47835ba5de1a42cc94c09b33a187868a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:55:01.989312 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-6dbcc3bf-d44b-402b-8a4c-1fcc2f700811 tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] 10.222.0.26 "GET /compute/v2.1/servers/ca6cb405-f00a-4fcf-9147-824793f35ebf" status: 200 len: 1260 microversion: 2.1 time: 0.290463 Mar 05 02:55:02.005335 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 193/398] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:55:01 2022] GET /compute/v2.1/servers/ca6cb405-f00a-4fcf-9147-824793f35ebf => generated 1260 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 02:55:02.226220 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-8a65f868-3931-4cc3-ac88-d6b433d9875d tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:55:02.243867 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-8a65f868-3931-4cc3-ac88-d6b433d9875d tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:55:02.245082 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-8a65f868-3931-4cc3-ac88-d6b433d9875d tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:55:02.246489 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-8a65f868-3931-4cc3-ac88-d6b433d9875d tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] 10.222.0.26 "GET /compute/v2.1/servers/e28e570d-3d50-4fe8-bb4a-fe0e95c20fb7" status: 200 len: 1808 microversion: 2.20 time: 0.347429 Mar 05 02:55:02.247592 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 206/399] 10.222.0.26 () {60 vars in 1276 bytes} [Sat Mar 5 02:55:01 2022] GET /compute/v2.1/servers/e28e570d-3d50-4fe8-bb4a-fe0e95c20fb7 => generated 1808 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 02:55:02.294138 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-57db3341-60a4-405c-b589-60d316a15357 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:55:02.295132 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-57db3341-60a4-405c-b589-60d316a15357 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] [instance: c24fee69-5bf4-40f4-ba18-56aecd12dd96] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:55:02.313912 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-57db3341-60a4-405c-b589-60d316a15357 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:55:02.314408 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-57db3341-60a4-405c-b589-60d316a15357 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:55:02.323045 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-57db3341-60a4-405c-b589-60d316a15357 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:55:02.324189 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-57db3341-60a4-405c-b589-60d316a15357 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:55:02.639807 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-57db3341-60a4-405c-b589-60d316a15357 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90033e5e8e634b699bf050e36519f8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8112a5759c444c1f94be24ab61bf072f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:55:02.648604 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-57db3341-60a4-405c-b589-60d316a15357 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] 10.222.0.26 "GET /compute/v2.1/servers/c24fee69-5bf4-40f4-ba18-56aecd12dd96" status: 200 len: 1566 microversion: 2.1 time: 0.363662 Mar 05 02:55:02.649558 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 194/400] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:55:02 2022] GET /compute/v2.1/servers/c24fee69-5bf4-40f4-ba18-56aecd12dd96 => generated 1566 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 02:55:03.010539 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-71736b9d-dcbf-4fa4-b614-41d75758fae7 tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:55:03.011913 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-71736b9d-dcbf-4fa4-b614-41d75758fae7 tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] [instance: ca6cb405-f00a-4fcf-9147-824793f35ebf] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:55:03.020357 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-71736b9d-dcbf-4fa4-b614-41d75758fae7 tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:55:03.021154 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-71736b9d-dcbf-4fa4-b614-41d75758fae7 tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:55:03.022389 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-71736b9d-dcbf-4fa4-b614-41d75758fae7 tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:55:03.023289 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-71736b9d-dcbf-4fa4-b614-41d75758fae7 tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:55:03.212312 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-71736b9d-dcbf-4fa4-b614-41d75758fae7 tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c68b816379942e282577e3d8d624ae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47835ba5de1a42cc94c09b33a187868a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:55:03.220363 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-71736b9d-dcbf-4fa4-b614-41d75758fae7 tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] 10.222.0.26 "GET /compute/v2.1/servers/ca6cb405-f00a-4fcf-9147-824793f35ebf" status: 200 len: 1260 microversion: 2.1 time: 0.214297 Mar 05 02:55:03.230256 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 207/401] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:55:03 2022] GET /compute/v2.1/servers/ca6cb405-f00a-4fcf-9147-824793f35ebf => generated 1260 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 02:55:03.264796 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-ed1d7671-eaac-48d2-9e58-fddd3bd9b309 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:55:03.265333 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-ed1d7671-eaac-48d2-9e58-fddd3bd9b309 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] [instance: e28e570d-3d50-4fe8-bb4a-fe0e95c20fb7] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:55:03.271802 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-ed1d7671-eaac-48d2-9e58-fddd3bd9b309 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:55:03.272256 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-ed1d7671-eaac-48d2-9e58-fddd3bd9b309 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:55:03.273023 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-ed1d7671-eaac-48d2-9e58-fddd3bd9b309 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:55:03.273463 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-ed1d7671-eaac-48d2-9e58-fddd3bd9b309 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:55:03.414186 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-ed1d7671-eaac-48d2-9e58-fddd3bd9b309 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:55:03.423035 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-ed1d7671-eaac-48d2-9e58-fddd3bd9b309 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:55:03.424539 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-ed1d7671-eaac-48d2-9e58-fddd3bd9b309 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:55:03.425690 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-ed1d7671-eaac-48d2-9e58-fddd3bd9b309 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] 10.222.0.26 "GET /compute/v2.1/servers/e28e570d-3d50-4fe8-bb4a-fe0e95c20fb7" status: 200 len: 1808 microversion: 2.20 time: 0.164892 Mar 05 02:55:03.426299 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 195/402] 10.222.0.26 () {60 vars in 1276 bytes} [Sat Mar 5 02:55:03 2022] GET /compute/v2.1/servers/e28e570d-3d50-4fe8-bb4a-fe0e95c20fb7 => generated 1808 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 02:55:03.668717 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-50fd9fbf-b3f2-474a-a357-aa225e2bdb0b tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:55:03.670860 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-50fd9fbf-b3f2-474a-a357-aa225e2bdb0b tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] [instance: c24fee69-5bf4-40f4-ba18-56aecd12dd96] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:55:03.685874 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-50fd9fbf-b3f2-474a-a357-aa225e2bdb0b tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:55:03.686511 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-50fd9fbf-b3f2-474a-a357-aa225e2bdb0b tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:55:03.687468 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-50fd9fbf-b3f2-474a-a357-aa225e2bdb0b tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:55:03.688147 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-50fd9fbf-b3f2-474a-a357-aa225e2bdb0b tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:55:03.858583 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-50fd9fbf-b3f2-474a-a357-aa225e2bdb0b tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90033e5e8e634b699bf050e36519f8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8112a5759c444c1f94be24ab61bf072f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:55:03.866664 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-50fd9fbf-b3f2-474a-a357-aa225e2bdb0b tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] 10.222.0.26 "GET /compute/v2.1/servers/c24fee69-5bf4-40f4-ba18-56aecd12dd96" status: 200 len: 1566 microversion: 2.1 time: 0.202799 Mar 05 02:55:03.877791 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 208/403] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:55:03 2022] GET /compute/v2.1/servers/c24fee69-5bf4-40f4-ba18-56aecd12dd96 => generated 1566 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 02:55:04.238387 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-8f94c1ee-f70e-49db-a242-d4c10264c243 tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:55:04.239117 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-8f94c1ee-f70e-49db-a242-d4c10264c243 tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] [instance: ca6cb405-f00a-4fcf-9147-824793f35ebf] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:55:04.245078 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-8f94c1ee-f70e-49db-a242-d4c10264c243 tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:55:04.245591 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-8f94c1ee-f70e-49db-a242-d4c10264c243 tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:55:04.246636 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-8f94c1ee-f70e-49db-a242-d4c10264c243 tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:55:04.247214 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-8f94c1ee-f70e-49db-a242-d4c10264c243 tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:55:04.445061 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-ebe67a7e-0618-435f-9fcd-bfc6ee6a6447 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:55:04.445677 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-ebe67a7e-0618-435f-9fcd-bfc6ee6a6447 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] [instance: e28e570d-3d50-4fe8-bb4a-fe0e95c20fb7] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:55:04.460124 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-8f94c1ee-f70e-49db-a242-d4c10264c243 tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c68b816379942e282577e3d8d624ae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47835ba5de1a42cc94c09b33a187868a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:55:04.464232 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-ebe67a7e-0618-435f-9fcd-bfc6ee6a6447 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:55:04.464955 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-ebe67a7e-0618-435f-9fcd-bfc6ee6a6447 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:55:04.472331 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-8f94c1ee-f70e-49db-a242-d4c10264c243 tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] 10.222.0.26 "GET /compute/v2.1/servers/ca6cb405-f00a-4fcf-9147-824793f35ebf" status: 200 len: 1260 microversion: 2.1 time: 0.237678 Mar 05 02:55:04.473196 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 196/404] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:55:04 2022] GET /compute/v2.1/servers/ca6cb405-f00a-4fcf-9147-824793f35ebf => generated 1260 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 02:55:04.473633 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-ebe67a7e-0618-435f-9fcd-bfc6ee6a6447 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:55:04.474538 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-ebe67a7e-0618-435f-9fcd-bfc6ee6a6447 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:55:04.644111 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-ebe67a7e-0618-435f-9fcd-bfc6ee6a6447 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:55:04.652942 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-ebe67a7e-0618-435f-9fcd-bfc6ee6a6447 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:55:04.655044 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-ebe67a7e-0618-435f-9fcd-bfc6ee6a6447 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:55:04.656446 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-ebe67a7e-0618-435f-9fcd-bfc6ee6a6447 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] 10.222.0.26 "GET /compute/v2.1/servers/e28e570d-3d50-4fe8-bb4a-fe0e95c20fb7" status: 200 len: 1808 microversion: 2.20 time: 0.215603 Mar 05 02:55:04.657235 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 209/405] 10.222.0.26 () {60 vars in 1276 bytes} [Sat Mar 5 02:55:04 2022] GET /compute/v2.1/servers/e28e570d-3d50-4fe8-bb4a-fe0e95c20fb7 => generated 1808 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 05 02:55:04.884490 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-d916b351-70f1-4215-b20e-617f7f8c9a94 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:55:04.885085 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-d916b351-70f1-4215-b20e-617f7f8c9a94 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] [instance: c24fee69-5bf4-40f4-ba18-56aecd12dd96] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:55:04.892220 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-d916b351-70f1-4215-b20e-617f7f8c9a94 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:55:04.892951 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-d916b351-70f1-4215-b20e-617f7f8c9a94 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:55:04.893723 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-d916b351-70f1-4215-b20e-617f7f8c9a94 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:55:04.894307 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-d916b351-70f1-4215-b20e-617f7f8c9a94 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:55:05.042741 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-d916b351-70f1-4215-b20e-617f7f8c9a94 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90033e5e8e634b699bf050e36519f8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8112a5759c444c1f94be24ab61bf072f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:55:05.051472 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-d916b351-70f1-4215-b20e-617f7f8c9a94 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] 10.222.0.26 "GET /compute/v2.1/servers/c24fee69-5bf4-40f4-ba18-56aecd12dd96" status: 200 len: 1566 microversion: 2.1 time: 0.170991 Mar 05 02:55:05.052086 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 197/406] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:55:04 2022] GET /compute/v2.1/servers/c24fee69-5bf4-40f4-ba18-56aecd12dd96 => generated 1566 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 02:55:05.489109 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-f5a5dd0c-1d2c-4101-b15d-4ac65eab9e47 tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:55:05.490522 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-f5a5dd0c-1d2c-4101-b15d-4ac65eab9e47 tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] [instance: ca6cb405-f00a-4fcf-9147-824793f35ebf] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:55:05.498869 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-f5a5dd0c-1d2c-4101-b15d-4ac65eab9e47 tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:55:05.499644 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-f5a5dd0c-1d2c-4101-b15d-4ac65eab9e47 tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:55:05.500801 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-f5a5dd0c-1d2c-4101-b15d-4ac65eab9e47 tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:55:05.501457 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-f5a5dd0c-1d2c-4101-b15d-4ac65eab9e47 tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:55:05.642100 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-f5a5dd0c-1d2c-4101-b15d-4ac65eab9e47 tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c68b816379942e282577e3d8d624ae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47835ba5de1a42cc94c09b33a187868a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:55:05.649897 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-f5a5dd0c-1d2c-4101-b15d-4ac65eab9e47 tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] 10.222.0.26 "GET /compute/v2.1/servers/ca6cb405-f00a-4fcf-9147-824793f35ebf" status: 200 len: 1260 microversion: 2.1 time: 0.164719 Mar 05 02:55:05.650504 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 210/407] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:55:05 2022] GET /compute/v2.1/servers/ca6cb405-f00a-4fcf-9147-824793f35ebf => generated 1260 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 02:55:05.675581 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-ee0c474a-e0cf-4e89-8a7d-c00cf5ebbe23 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:55:05.676829 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-ee0c474a-e0cf-4e89-8a7d-c00cf5ebbe23 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] [instance: e28e570d-3d50-4fe8-bb4a-fe0e95c20fb7] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:55:05.684211 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-ee0c474a-e0cf-4e89-8a7d-c00cf5ebbe23 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:55:05.685720 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-ee0c474a-e0cf-4e89-8a7d-c00cf5ebbe23 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:55:05.686611 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-ee0c474a-e0cf-4e89-8a7d-c00cf5ebbe23 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:55:05.687051 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-ee0c474a-e0cf-4e89-8a7d-c00cf5ebbe23 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:55:05.864631 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-ee0c474a-e0cf-4e89-8a7d-c00cf5ebbe23 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:55:05.873990 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-ee0c474a-e0cf-4e89-8a7d-c00cf5ebbe23 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:55:05.875534 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-ee0c474a-e0cf-4e89-8a7d-c00cf5ebbe23 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:55:05.876726 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-ee0c474a-e0cf-4e89-8a7d-c00cf5ebbe23 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] 10.222.0.26 "GET /compute/v2.1/servers/e28e570d-3d50-4fe8-bb4a-fe0e95c20fb7" status: 200 len: 1808 microversion: 2.20 time: 0.205274 Mar 05 02:55:05.877310 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 198/408] 10.222.0.26 () {60 vars in 1276 bytes} [Sat Mar 5 02:55:05 2022] GET /compute/v2.1/servers/e28e570d-3d50-4fe8-bb4a-fe0e95c20fb7 => generated 1808 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 02:55:06.069783 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-a1212e10-5919-4210-a8c1-551d1e1d858f tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:55:06.070448 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-a1212e10-5919-4210-a8c1-551d1e1d858f tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] [instance: c24fee69-5bf4-40f4-ba18-56aecd12dd96] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:55:06.076952 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-a1212e10-5919-4210-a8c1-551d1e1d858f tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:55:06.077495 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-a1212e10-5919-4210-a8c1-551d1e1d858f tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:55:06.078489 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-a1212e10-5919-4210-a8c1-551d1e1d858f tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:55:06.079165 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-a1212e10-5919-4210-a8c1-551d1e1d858f tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:55:06.236791 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-a1212e10-5919-4210-a8c1-551d1e1d858f tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90033e5e8e634b699bf050e36519f8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8112a5759c444c1f94be24ab61bf072f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:55:06.248784 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-a1212e10-5919-4210-a8c1-551d1e1d858f tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] 10.222.0.26 "GET /compute/v2.1/servers/c24fee69-5bf4-40f4-ba18-56aecd12dd96" status: 200 len: 1546 microversion: 2.1 time: 0.181902 Mar 05 02:55:06.249637 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 211/409] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:55:06 2022] GET /compute/v2.1/servers/c24fee69-5bf4-40f4-ba18-56aecd12dd96 => generated 1546 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 02:55:06.266545 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-443a6ad2-6286-4cdc-b8a6-edbf58e81461 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:55:06.267266 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-443a6ad2-6286-4cdc-b8a6-edbf58e81461 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] [instance: c24fee69-5bf4-40f4-ba18-56aecd12dd96] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:55:06.279655 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-443a6ad2-6286-4cdc-b8a6-edbf58e81461 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:55:06.280729 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-443a6ad2-6286-4cdc-b8a6-edbf58e81461 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:55:06.281905 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-443a6ad2-6286-4cdc-b8a6-edbf58e81461 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:55:06.282489 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-443a6ad2-6286-4cdc-b8a6-edbf58e81461 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:55:06.437761 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.wsgi [None req-443a6ad2-6286-4cdc-b8a6-edbf58e81461 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] HTTP exception thrown: Cannot 'detach_volume' instance c24fee69-5bf4-40f4-ba18-56aecd12dd96 while it is in vm_state rescued Mar 05 02:55:06.438675 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-443a6ad2-6286-4cdc-b8a6-edbf58e81461 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Returning 409 to user: Cannot 'detach_volume' instance c24fee69-5bf4-40f4-ba18-56aecd12dd96 while it is in vm_state rescued {{(pid=123546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 02:55:06.439742 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-443a6ad2-6286-4cdc-b8a6-edbf58e81461 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] 10.222.0.26 "DELETE /compute/v2.1/servers/c24fee69-5bf4-40f4-ba18-56aecd12dd96/os-volume_attachments/8ab37bc3-110b-43f6-a635-fa84fa57fec4" status: 409 len: 152 microversion: 2.1 time: 0.178367 Mar 05 02:55:06.440805 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 199/410] 10.222.0.26 () {58 vars in 1415 bytes} [Sat Mar 5 02:55:06 2022] DELETE /compute/v2.1/servers/c24fee69-5bf4-40f4-ba18-56aecd12dd96/os-volume_attachments/8ab37bc3-110b-43f6-a635-fa84fa57fec4 => generated 152 bytes in 180 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Mar 05 02:55:06.449182 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-7a851e2c-1e45-4d18-b643-3bb5aad67f4b tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 02:55:06.449716 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-7a851e2c-1e45-4d18-b643-3bb5aad67f4b tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] [instance: c24fee69-5bf4-40f4-ba18-56aecd12dd96] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:55:06.456287 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-7a851e2c-1e45-4d18-b643-3bb5aad67f4b tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:55:06.456742 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-7a851e2c-1e45-4d18-b643-3bb5aad67f4b tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:55:06.457521 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-7a851e2c-1e45-4d18-b643-3bb5aad67f4b tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:55:06.457982 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-7a851e2c-1e45-4d18-b643-3bb5aad67f4b tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:55:06.537342 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-7a851e2c-1e45-4d18-b643-3bb5aad67f4b tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] 10.222.0.26 "POST /compute/v2.1/servers/c24fee69-5bf4-40f4-ba18-56aecd12dd96/action" status: 202 len: 0 microversion: 2.1 time: 0.091829 Mar 05 02:55:06.541298 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 212/411] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Mar 5 02:55:06 2022] POST /compute/v2.1/servers/c24fee69-5bf4-40f4-ba18-56aecd12dd96/action => generated 0 bytes in 94 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 05 02:55:06.547496 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-570f2e5b-acfb-4db7-b29d-d5888abe7adb tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:55:06.548330 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-570f2e5b-acfb-4db7-b29d-d5888abe7adb tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] [instance: c24fee69-5bf4-40f4-ba18-56aecd12dd96] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:55:06.555443 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-570f2e5b-acfb-4db7-b29d-d5888abe7adb tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:55:06.556134 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-570f2e5b-acfb-4db7-b29d-d5888abe7adb tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:55:06.557078 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-570f2e5b-acfb-4db7-b29d-d5888abe7adb tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:55:06.557518 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-570f2e5b-acfb-4db7-b29d-d5888abe7adb tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:55:06.667600 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-7b564fe5-cada-4424-a98b-90acd1f6f1b5 tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:55:06.668307 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-7b564fe5-cada-4424-a98b-90acd1f6f1b5 tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] [instance: ca6cb405-f00a-4fcf-9147-824793f35ebf] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:55:06.675765 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-7b564fe5-cada-4424-a98b-90acd1f6f1b5 tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:55:06.676206 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-7b564fe5-cada-4424-a98b-90acd1f6f1b5 tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:55:06.676978 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-7b564fe5-cada-4424-a98b-90acd1f6f1b5 tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:55:06.677584 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-7b564fe5-cada-4424-a98b-90acd1f6f1b5 tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:55:06.780763 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-570f2e5b-acfb-4db7-b29d-d5888abe7adb tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90033e5e8e634b699bf050e36519f8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8112a5759c444c1f94be24ab61bf072f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:55:06.790644 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-570f2e5b-acfb-4db7-b29d-d5888abe7adb tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] 10.222.0.26 "GET /compute/v2.1/servers/c24fee69-5bf4-40f4-ba18-56aecd12dd96" status: 200 len: 1554 microversion: 2.1 time: 0.247807 Mar 05 02:55:06.791225 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 200/412] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:55:06 2022] GET /compute/v2.1/servers/c24fee69-5bf4-40f4-ba18-56aecd12dd96 => generated 1554 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 02:55:06.896193 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-a5246960-3196-42b1-90df-09a304c53c1c tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:55:06.896985 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-a5246960-3196-42b1-90df-09a304c53c1c tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] [instance: e28e570d-3d50-4fe8-bb4a-fe0e95c20fb7] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:55:06.912432 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-a5246960-3196-42b1-90df-09a304c53c1c tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:55:06.912817 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-a5246960-3196-42b1-90df-09a304c53c1c tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:55:06.913602 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-a5246960-3196-42b1-90df-09a304c53c1c tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:55:06.914066 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-a5246960-3196-42b1-90df-09a304c53c1c tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:55:06.929025 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-7b564fe5-cada-4424-a98b-90acd1f6f1b5 tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c68b816379942e282577e3d8d624ae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47835ba5de1a42cc94c09b33a187868a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:55:06.936995 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-7b564fe5-cada-4424-a98b-90acd1f6f1b5 tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] 10.222.0.26 "GET /compute/v2.1/servers/ca6cb405-f00a-4fcf-9147-824793f35ebf" status: 200 len: 1260 microversion: 2.1 time: 0.273624 Mar 05 02:55:06.937580 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 213/413] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:55:06 2022] GET /compute/v2.1/servers/ca6cb405-f00a-4fcf-9147-824793f35ebf => generated 1260 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 02:55:07.110508 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-a5246960-3196-42b1-90df-09a304c53c1c tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:55:07.118924 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-a5246960-3196-42b1-90df-09a304c53c1c tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:55:07.120434 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-a5246960-3196-42b1-90df-09a304c53c1c tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:55:07.121588 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-a5246960-3196-42b1-90df-09a304c53c1c tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] 10.222.0.26 "GET /compute/v2.1/servers/e28e570d-3d50-4fe8-bb4a-fe0e95c20fb7" status: 200 len: 1808 microversion: 2.20 time: 0.230360 Mar 05 02:55:07.122885 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 201/414] 10.222.0.26 () {60 vars in 1276 bytes} [Sat Mar 5 02:55:06 2022] GET /compute/v2.1/servers/e28e570d-3d50-4fe8-bb4a-fe0e95c20fb7 => generated 1808 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 05 02:55:07.671824 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-69310355-1725-4007-8364-3ea0d00950f2 tempest-VolumesSnapshotTestJSON-729970751 tempest-VolumesSnapshotTestJSON-729970751-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ca67d8ea-b943-4a3c-bc74-d3ecfe5c2fe6", "device": "/dev/sdb"}} {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 02:55:07.673527 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-69310355-1725-4007-8364-3ea0d00950f2 tempest-VolumesSnapshotTestJSON-729970751 tempest-VolumesSnapshotTestJSON-729970751-project] [instance: b89e62f7-7ccc-48a6-ad76-88f6e022fe95] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:55:07.680305 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-69310355-1725-4007-8364-3ea0d00950f2 tempest-VolumesSnapshotTestJSON-729970751 tempest-VolumesSnapshotTestJSON-729970751-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:55:07.680763 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-69310355-1725-4007-8364-3ea0d00950f2 tempest-VolumesSnapshotTestJSON-729970751 tempest-VolumesSnapshotTestJSON-729970751-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:55:07.681675 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-69310355-1725-4007-8364-3ea0d00950f2 tempest-VolumesSnapshotTestJSON-729970751 tempest-VolumesSnapshotTestJSON-729970751-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:55:07.681991 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-69310355-1725-4007-8364-3ea0d00950f2 tempest-VolumesSnapshotTestJSON-729970751 tempest-VolumesSnapshotTestJSON-729970751-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:55:07.810158 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-2c4fb172-e77a-4d8e-b6c5-c834d8b9fb56 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:55:07.810790 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-2c4fb172-e77a-4d8e-b6c5-c834d8b9fb56 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] [instance: c24fee69-5bf4-40f4-ba18-56aecd12dd96] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:55:07.817984 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-2c4fb172-e77a-4d8e-b6c5-c834d8b9fb56 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:55:07.818517 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-2c4fb172-e77a-4d8e-b6c5-c834d8b9fb56 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:55:07.819983 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-2c4fb172-e77a-4d8e-b6c5-c834d8b9fb56 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:55:07.820484 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-2c4fb172-e77a-4d8e-b6c5-c834d8b9fb56 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:55:07.942704 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-69310355-1725-4007-8364-3ea0d00950f2 tempest-VolumesSnapshotTestJSON-729970751 tempest-VolumesSnapshotTestJSON-729970751-project] 10.222.0.26 "POST /compute/v2.1/servers/b89e62f7-7ccc-48a6-ad76-88f6e022fe95/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.276214 Mar 05 02:55:07.944129 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 214/415] 10.222.0.26 () {60 vars in 1322 bytes} [Sat Mar 5 02:55:07 2022] POST /compute/v2.1/servers/b89e62f7-7ccc-48a6-ad76-88f6e022fe95/os-volume_attachments => generated 194 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 02:55:07.955510 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-5ad0d81f-8634-4a36-a9b8-d46825ee7d4f tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:55:07.956613 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-5ad0d81f-8634-4a36-a9b8-d46825ee7d4f tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] [instance: ca6cb405-f00a-4fcf-9147-824793f35ebf] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:55:07.966255 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-5ad0d81f-8634-4a36-a9b8-d46825ee7d4f tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:55:07.967161 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-5ad0d81f-8634-4a36-a9b8-d46825ee7d4f tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:55:07.968390 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-5ad0d81f-8634-4a36-a9b8-d46825ee7d4f tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:55:07.968995 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-5ad0d81f-8634-4a36-a9b8-d46825ee7d4f tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:55:08.115266 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-2c4fb172-e77a-4d8e-b6c5-c834d8b9fb56 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90033e5e8e634b699bf050e36519f8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8112a5759c444c1f94be24ab61bf072f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:55:08.129731 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-2c4fb172-e77a-4d8e-b6c5-c834d8b9fb56 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] 10.222.0.26 "GET /compute/v2.1/servers/c24fee69-5bf4-40f4-ba18-56aecd12dd96" status: 200 len: 1554 microversion: 2.1 time: 0.321651 Mar 05 02:55:08.129731 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 202/416] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:55:07 2022] GET /compute/v2.1/servers/c24fee69-5bf4-40f4-ba18-56aecd12dd96 => generated 1554 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 02:55:08.143848 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-3f19c38c-9391-4dab-afd0-656dd7477a8b tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:55:08.144463 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-3f19c38c-9391-4dab-afd0-656dd7477a8b tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] [instance: e28e570d-3d50-4fe8-bb4a-fe0e95c20fb7] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:55:08.159231 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-3f19c38c-9391-4dab-afd0-656dd7477a8b tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:55:08.160188 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-3f19c38c-9391-4dab-afd0-656dd7477a8b tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:55:08.161392 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-3f19c38c-9391-4dab-afd0-656dd7477a8b tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:55:08.162222 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-3f19c38c-9391-4dab-afd0-656dd7477a8b tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:55:08.541562 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-5ad0d81f-8634-4a36-a9b8-d46825ee7d4f tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c68b816379942e282577e3d8d624ae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47835ba5de1a42cc94c09b33a187868a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:55:08.551027 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-5ad0d81f-8634-4a36-a9b8-d46825ee7d4f tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] 10.222.0.26 "GET /compute/v2.1/servers/ca6cb405-f00a-4fcf-9147-824793f35ebf" status: 200 len: 1260 microversion: 2.1 time: 0.601488 Mar 05 02:55:08.551589 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 215/417] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:55:07 2022] GET /compute/v2.1/servers/ca6cb405-f00a-4fcf-9147-824793f35ebf => generated 1260 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 02:55:08.651183 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-3f19c38c-9391-4dab-afd0-656dd7477a8b tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:55:08.661341 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-3f19c38c-9391-4dab-afd0-656dd7477a8b tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:55:08.663570 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-3f19c38c-9391-4dab-afd0-656dd7477a8b tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:55:08.665084 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-3f19c38c-9391-4dab-afd0-656dd7477a8b tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] 10.222.0.26 "GET /compute/v2.1/servers/e28e570d-3d50-4fe8-bb4a-fe0e95c20fb7" status: 200 len: 1808 microversion: 2.20 time: 0.526238 Mar 05 02:55:08.671851 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 203/418] 10.222.0.26 () {60 vars in 1276 bytes} [Sat Mar 5 02:55:08 2022] GET /compute/v2.1/servers/e28e570d-3d50-4fe8-bb4a-fe0e95c20fb7 => generated 1808 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 02:55:09.147017 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-92a62c97-78f1-4642-9b14-085196fc41e1 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:55:09.148134 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-92a62c97-78f1-4642-9b14-085196fc41e1 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] [instance: c24fee69-5bf4-40f4-ba18-56aecd12dd96] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:55:09.154800 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-92a62c97-78f1-4642-9b14-085196fc41e1 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:55:09.155249 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-92a62c97-78f1-4642-9b14-085196fc41e1 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:55:09.156020 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-92a62c97-78f1-4642-9b14-085196fc41e1 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:55:09.156613 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-92a62c97-78f1-4642-9b14-085196fc41e1 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:55:09.305686 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-92a62c97-78f1-4642-9b14-085196fc41e1 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90033e5e8e634b699bf050e36519f8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8112a5759c444c1f94be24ab61bf072f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:55:09.314590 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-92a62c97-78f1-4642-9b14-085196fc41e1 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] 10.222.0.26 "GET /compute/v2.1/servers/c24fee69-5bf4-40f4-ba18-56aecd12dd96" status: 200 len: 1554 microversion: 2.1 time: 0.171583 Mar 05 02:55:09.315713 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 216/419] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:55:09 2022] GET /compute/v2.1/servers/c24fee69-5bf4-40f4-ba18-56aecd12dd96 => generated 1554 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 02:55:09.568057 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-6a334e9b-bc27-49dd-ab02-d8708415b934 tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:55:09.568628 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-6a334e9b-bc27-49dd-ab02-d8708415b934 tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] [instance: ca6cb405-f00a-4fcf-9147-824793f35ebf] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:55:09.575539 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-6a334e9b-bc27-49dd-ab02-d8708415b934 tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:55:09.576526 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-6a334e9b-bc27-49dd-ab02-d8708415b934 tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:55:09.577316 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-6a334e9b-bc27-49dd-ab02-d8708415b934 tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:55:09.577753 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-6a334e9b-bc27-49dd-ab02-d8708415b934 tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:55:09.686143 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-b45ecba8-be55-4a91-b92e-e23976907df3 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:55:09.686756 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-b45ecba8-be55-4a91-b92e-e23976907df3 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] [instance: e28e570d-3d50-4fe8-bb4a-fe0e95c20fb7] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:55:09.693009 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-b45ecba8-be55-4a91-b92e-e23976907df3 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:55:09.693464 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-b45ecba8-be55-4a91-b92e-e23976907df3 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:55:09.694261 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-b45ecba8-be55-4a91-b92e-e23976907df3 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:55:09.694693 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-b45ecba8-be55-4a91-b92e-e23976907df3 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:55:09.720983 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-6a334e9b-bc27-49dd-ab02-d8708415b934 tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c68b816379942e282577e3d8d624ae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47835ba5de1a42cc94c09b33a187868a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:55:09.744946 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-6a334e9b-bc27-49dd-ab02-d8708415b934 tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] 10.222.0.26 "GET /compute/v2.1/servers/ca6cb405-f00a-4fcf-9147-824793f35ebf" status: 200 len: 1260 microversion: 2.1 time: 0.180626 Mar 05 02:55:09.745800 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 204/420] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:55:09 2022] GET /compute/v2.1/servers/ca6cb405-f00a-4fcf-9147-824793f35ebf => generated 1260 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 02:55:09.946823 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-b45ecba8-be55-4a91-b92e-e23976907df3 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:55:09.955721 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-b45ecba8-be55-4a91-b92e-e23976907df3 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:55:09.957519 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-b45ecba8-be55-4a91-b92e-e23976907df3 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:55:09.958700 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-b45ecba8-be55-4a91-b92e-e23976907df3 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] 10.222.0.26 "GET /compute/v2.1/servers/e28e570d-3d50-4fe8-bb4a-fe0e95c20fb7" status: 200 len: 1808 microversion: 2.20 time: 0.277999 Mar 05 02:55:09.959743 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 217/421] 10.222.0.26 () {60 vars in 1276 bytes} [Sat Mar 5 02:55:09 2022] GET /compute/v2.1/servers/e28e570d-3d50-4fe8-bb4a-fe0e95c20fb7 => generated 1808 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 02:55:10.332185 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-a32836e0-f537-4df2-bac0-00cc89c63a42 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:55:10.332786 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-a32836e0-f537-4df2-bac0-00cc89c63a42 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] [instance: c24fee69-5bf4-40f4-ba18-56aecd12dd96] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:55:10.338674 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-a32836e0-f537-4df2-bac0-00cc89c63a42 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:55:10.339126 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-a32836e0-f537-4df2-bac0-00cc89c63a42 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:55:10.339893 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-a32836e0-f537-4df2-bac0-00cc89c63a42 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:55:10.340328 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-a32836e0-f537-4df2-bac0-00cc89c63a42 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:55:10.529735 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-a32836e0-f537-4df2-bac0-00cc89c63a42 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90033e5e8e634b699bf050e36519f8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8112a5759c444c1f94be24ab61bf072f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:55:10.537599 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-a32836e0-f537-4df2-bac0-00cc89c63a42 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] 10.222.0.26 "GET /compute/v2.1/servers/c24fee69-5bf4-40f4-ba18-56aecd12dd96" status: 200 len: 1560 microversion: 2.1 time: 0.209306 Mar 05 02:55:10.538204 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 205/422] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:55:10 2022] GET /compute/v2.1/servers/c24fee69-5bf4-40f4-ba18-56aecd12dd96 => generated 1560 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 02:55:10.615894 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-3e9b03cc-2ca4-49a8-b41e-855f0e1acbb7 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:55:10.616438 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-3e9b03cc-2ca4-49a8-b41e-855f0e1acbb7 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] [instance: c24fee69-5bf4-40f4-ba18-56aecd12dd96] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:55:10.622292 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-3e9b03cc-2ca4-49a8-b41e-855f0e1acbb7 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:55:10.622833 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-3e9b03cc-2ca4-49a8-b41e-855f0e1acbb7 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:55:10.623516 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-3e9b03cc-2ca4-49a8-b41e-855f0e1acbb7 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:55:10.623955 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-3e9b03cc-2ca4-49a8-b41e-855f0e1acbb7 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:55:10.750231 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.objects.instance [None req-3e9b03cc-2ca4-49a8-b41e-855f0e1acbb7 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lazy-loading 'services' on Instance uuid c24fee69-5bf4-40f4-ba18-56aecd12dd96 {{(pid=123545) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 05 02:55:10.763225 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-c8418be1-da81-4d45-a052-1796df3b97a6 tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:55:10.764052 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-c8418be1-da81-4d45-a052-1796df3b97a6 tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] [instance: ca6cb405-f00a-4fcf-9147-824793f35ebf] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:55:10.770613 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-c8418be1-da81-4d45-a052-1796df3b97a6 tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:55:10.771274 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-c8418be1-da81-4d45-a052-1796df3b97a6 tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:55:10.772240 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-c8418be1-da81-4d45-a052-1796df3b97a6 tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:55:10.772769 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-c8418be1-da81-4d45-a052-1796df3b97a6 tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:55:10.871900 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-3e9b03cc-2ca4-49a8-b41e-855f0e1acbb7 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] 10.222.0.26 "DELETE /compute/v2.1/servers/c24fee69-5bf4-40f4-ba18-56aecd12dd96/os-volume_attachments/8ab37bc3-110b-43f6-a635-fa84fa57fec4" status: 202 len: 0 microversion: 2.1 time: 0.260669 Mar 05 02:55:10.876189 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 218/423] 10.222.0.26 () {58 vars in 1415 bytes} [Sat Mar 5 02:55:10 2022] DELETE /compute/v2.1/servers/c24fee69-5bf4-40f4-ba18-56aecd12dd96/os-volume_attachments/8ab37bc3-110b-43f6-a635-fa84fa57fec4 => generated 0 bytes in 266 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 05 02:55:10.881799 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-5e90d4b2-12df-4899-8719-b3ecf9713f3a tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:55:10.882903 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-5e90d4b2-12df-4899-8719-b3ecf9713f3a tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] [instance: c24fee69-5bf4-40f4-ba18-56aecd12dd96] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:55:10.890280 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-5e90d4b2-12df-4899-8719-b3ecf9713f3a tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:55:10.891047 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-5e90d4b2-12df-4899-8719-b3ecf9713f3a tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:55:10.892065 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-5e90d4b2-12df-4899-8719-b3ecf9713f3a tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:55:10.892693 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-5e90d4b2-12df-4899-8719-b3ecf9713f3a tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:55:10.926602 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-5e90d4b2-12df-4899-8719-b3ecf9713f3a tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] 10.222.0.26 "GET /compute/v2.1/servers/c24fee69-5bf4-40f4-ba18-56aecd12dd96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049102 Mar 05 02:55:10.927623 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 219/424] 10.222.0.26 () {58 vars in 1301 bytes} [Sat Mar 5 02:55:10 2022] GET /compute/v2.1/servers/c24fee69-5bf4-40f4-ba18-56aecd12dd96/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 02:55:10.940343 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-c8418be1-da81-4d45-a052-1796df3b97a6 tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c68b816379942e282577e3d8d624ae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47835ba5de1a42cc94c09b33a187868a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:55:10.947256 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-c8418be1-da81-4d45-a052-1796df3b97a6 tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] 10.222.0.26 "GET /compute/v2.1/servers/ca6cb405-f00a-4fcf-9147-824793f35ebf" status: 200 len: 1260 microversion: 2.1 time: 0.189053 Mar 05 02:55:10.948413 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 206/425] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:55:10 2022] GET /compute/v2.1/servers/ca6cb405-f00a-4fcf-9147-824793f35ebf => generated 1260 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 02:55:10.977304 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-082ca5ca-3a48-4d4f-91b0-0c2c2ab83c36 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:55:10.978189 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-082ca5ca-3a48-4d4f-91b0-0c2c2ab83c36 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] [instance: e28e570d-3d50-4fe8-bb4a-fe0e95c20fb7] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:55:10.984962 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-082ca5ca-3a48-4d4f-91b0-0c2c2ab83c36 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:55:10.985403 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-082ca5ca-3a48-4d4f-91b0-0c2c2ab83c36 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:55:10.986204 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-082ca5ca-3a48-4d4f-91b0-0c2c2ab83c36 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:55:10.986636 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-082ca5ca-3a48-4d4f-91b0-0c2c2ab83c36 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:55:11.125654 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-082ca5ca-3a48-4d4f-91b0-0c2c2ab83c36 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:55:11.134588 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-082ca5ca-3a48-4d4f-91b0-0c2c2ab83c36 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:55:11.136071 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-082ca5ca-3a48-4d4f-91b0-0c2c2ab83c36 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:55:11.137210 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-082ca5ca-3a48-4d4f-91b0-0c2c2ab83c36 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] 10.222.0.26 "GET /compute/v2.1/servers/e28e570d-3d50-4fe8-bb4a-fe0e95c20fb7" status: 200 len: 1808 microversion: 2.20 time: 0.164032 Mar 05 02:55:11.138552 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 220/426] 10.222.0.26 () {60 vars in 1276 bytes} [Sat Mar 5 02:55:10 2022] GET /compute/v2.1/servers/e28e570d-3d50-4fe8-bb4a-fe0e95c20fb7 => generated 1808 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 02:55:11.294684 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [req-4c428291-ce54-4da8-b069-1c79fdee33d0 req-2008a056-05f3-4300-a122-26d08968fc12 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca6cb405-f00a-4fcf-9147-824793f35ebf", "name": "network-vif-plugged", "status": "completed", "tag": "6c993446-3f76-4f92-94ad-2054b8a5ebfe"}]} {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 02:55:11.302521 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [req-4c428291-ce54-4da8-b069-1c79fdee33d0 req-2008a056-05f3-4300-a122-26d08968fc12 service nova] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:55:11.302962 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [req-4c428291-ce54-4da8-b069-1c79fdee33d0 req-2008a056-05f3-4300-a122-26d08968fc12 service nova] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:55:11.314525 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.compute.server_external_events [req-4c428291-ce54-4da8-b069-1c79fdee33d0 req-2008a056-05f3-4300-a122-26d08968fc12 service nova] Creating event network-vif-plugged:6c993446-3f76-4f92-94ad-2054b8a5ebfe for instance ca6cb405-f00a-4fcf-9147-824793f35ebf on hv-cinder-82725 Mar 05 02:55:11.319506 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [req-4c428291-ce54-4da8-b069-1c79fdee33d0 req-2008a056-05f3-4300-a122-26d08968fc12 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028633 Mar 05 02:55:11.320137 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 207/427] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Mar 5 02:55:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 02:55:11.939399 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-dfb470f4-7034-46cf-95a3-dae77a82548f tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:55:11.940464 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-dfb470f4-7034-46cf-95a3-dae77a82548f tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] [instance: c24fee69-5bf4-40f4-ba18-56aecd12dd96] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:55:11.947250 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-dfb470f4-7034-46cf-95a3-dae77a82548f tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:55:11.947744 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-dfb470f4-7034-46cf-95a3-dae77a82548f tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:55:11.948582 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-dfb470f4-7034-46cf-95a3-dae77a82548f tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:55:11.949075 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-dfb470f4-7034-46cf-95a3-dae77a82548f tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:55:11.965335 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-9d9e270f-55ec-493f-b533-45ce1cbec691 tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:55:11.967369 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-9d9e270f-55ec-493f-b533-45ce1cbec691 tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] [instance: ca6cb405-f00a-4fcf-9147-824793f35ebf] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:55:11.973623 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-9d9e270f-55ec-493f-b533-45ce1cbec691 tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:55:11.974221 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-9d9e270f-55ec-493f-b533-45ce1cbec691 tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:55:11.975052 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-9d9e270f-55ec-493f-b533-45ce1cbec691 tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:55:11.975562 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-9d9e270f-55ec-493f-b533-45ce1cbec691 tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:55:11.982990 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-dfb470f4-7034-46cf-95a3-dae77a82548f tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] 10.222.0.26 "GET /compute/v2.1/servers/c24fee69-5bf4-40f4-ba18-56aecd12dd96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048073 Mar 05 02:55:11.983563 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 221/428] 10.222.0.26 () {58 vars in 1301 bytes} [Sat Mar 5 02:55:11 2022] GET /compute/v2.1/servers/c24fee69-5bf4-40f4-ba18-56aecd12dd96/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 02:55:12.112838 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-9d9e270f-55ec-493f-b533-45ce1cbec691 tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c68b816379942e282577e3d8d624ae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47835ba5de1a42cc94c09b33a187868a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:55:12.120063 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-9d9e270f-55ec-493f-b533-45ce1cbec691 tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] 10.222.0.26 "GET /compute/v2.1/servers/ca6cb405-f00a-4fcf-9147-824793f35ebf" status: 200 len: 1260 microversion: 2.1 time: 0.159264 Mar 05 02:55:12.120626 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 208/429] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:55:11 2022] GET /compute/v2.1/servers/ca6cb405-f00a-4fcf-9147-824793f35ebf => generated 1260 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 02:55:12.156016 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-731d69ae-0d52-464a-8f42-25c390f37353 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:55:12.156616 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-731d69ae-0d52-464a-8f42-25c390f37353 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] [instance: e28e570d-3d50-4fe8-bb4a-fe0e95c20fb7] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:55:12.162346 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-731d69ae-0d52-464a-8f42-25c390f37353 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:55:12.162794 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-731d69ae-0d52-464a-8f42-25c390f37353 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:55:12.163546 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-731d69ae-0d52-464a-8f42-25c390f37353 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:55:12.163974 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-731d69ae-0d52-464a-8f42-25c390f37353 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:55:12.297053 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-731d69ae-0d52-464a-8f42-25c390f37353 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:55:12.305348 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-731d69ae-0d52-464a-8f42-25c390f37353 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:55:12.306927 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-731d69ae-0d52-464a-8f42-25c390f37353 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:55:12.308080 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-731d69ae-0d52-464a-8f42-25c390f37353 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] 10.222.0.26 "GET /compute/v2.1/servers/e28e570d-3d50-4fe8-bb4a-fe0e95c20fb7" status: 200 len: 1808 microversion: 2.20 time: 0.156082 Mar 05 02:55:12.308694 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 222/430] 10.222.0.26 () {60 vars in 1276 bytes} [Sat Mar 5 02:55:12 2022] GET /compute/v2.1/servers/e28e570d-3d50-4fe8-bb4a-fe0e95c20fb7 => generated 1808 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 05 02:55:12.994620 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-3909e4db-f348-4fa7-9ee9-071afef7f853 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:55:12.995564 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-3909e4db-f348-4fa7-9ee9-071afef7f853 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] [instance: c24fee69-5bf4-40f4-ba18-56aecd12dd96] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:55:13.002710 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-3909e4db-f348-4fa7-9ee9-071afef7f853 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:55:13.003165 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-3909e4db-f348-4fa7-9ee9-071afef7f853 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:55:13.003938 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-3909e4db-f348-4fa7-9ee9-071afef7f853 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:55:13.004385 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-3909e4db-f348-4fa7-9ee9-071afef7f853 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:55:13.033644 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-3909e4db-f348-4fa7-9ee9-071afef7f853 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] 10.222.0.26 "GET /compute/v2.1/servers/c24fee69-5bf4-40f4-ba18-56aecd12dd96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042861 Mar 05 02:55:13.034554 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 209/431] 10.222.0.26 () {58 vars in 1301 bytes} [Sat Mar 5 02:55:12 2022] GET /compute/v2.1/servers/c24fee69-5bf4-40f4-ba18-56aecd12dd96/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 02:55:13.137927 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-9c12af1c-3197-4da0-a47d-cc4730486fac tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:55:13.138680 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-9c12af1c-3197-4da0-a47d-cc4730486fac tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] [instance: ca6cb405-f00a-4fcf-9147-824793f35ebf] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:55:13.145972 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-9c12af1c-3197-4da0-a47d-cc4730486fac tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:55:13.146439 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-9c12af1c-3197-4da0-a47d-cc4730486fac tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:55:13.147585 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-9c12af1c-3197-4da0-a47d-cc4730486fac tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:55:13.148057 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-9c12af1c-3197-4da0-a47d-cc4730486fac tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:55:13.283037 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-9c12af1c-3197-4da0-a47d-cc4730486fac tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c68b816379942e282577e3d8d624ae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47835ba5de1a42cc94c09b33a187868a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:55:13.290722 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-9c12af1c-3197-4da0-a47d-cc4730486fac tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] 10.222.0.26 "GET /compute/v2.1/servers/ca6cb405-f00a-4fcf-9147-824793f35ebf" status: 200 len: 1445 microversion: 2.1 time: 0.156846 Mar 05 02:55:13.291407 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 223/432] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:55:13 2022] GET /compute/v2.1/servers/ca6cb405-f00a-4fcf-9147-824793f35ebf => generated 1445 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 02:55:13.307607 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-de59339c-158c-4509-beaa-4e831729fdad tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:55:13.308211 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-de59339c-158c-4509-beaa-4e831729fdad tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] [instance: ca6cb405-f00a-4fcf-9147-824793f35ebf] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:55:13.315264 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-de59339c-158c-4509-beaa-4e831729fdad tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:55:13.315719 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-de59339c-158c-4509-beaa-4e831729fdad tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:55:13.316490 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-de59339c-158c-4509-beaa-4e831729fdad tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:55:13.316926 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-de59339c-158c-4509-beaa-4e831729fdad tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:55:13.328074 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-7bbd44e8-a217-45cb-84fb-ef9015b3b11b tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:55:13.328804 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-7bbd44e8-a217-45cb-84fb-ef9015b3b11b tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] [instance: e28e570d-3d50-4fe8-bb4a-fe0e95c20fb7] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:55:13.335851 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-7bbd44e8-a217-45cb-84fb-ef9015b3b11b tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:55:13.336283 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-7bbd44e8-a217-45cb-84fb-ef9015b3b11b tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:55:13.337123 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-7bbd44e8-a217-45cb-84fb-ef9015b3b11b tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:55:13.337558 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-7bbd44e8-a217-45cb-84fb-ef9015b3b11b tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:55:13.523135 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-de59339c-158c-4509-beaa-4e831729fdad tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c68b816379942e282577e3d8d624ae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47835ba5de1a42cc94c09b33a187868a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:55:13.526353 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-7bbd44e8-a217-45cb-84fb-ef9015b3b11b tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:55:13.531390 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-de59339c-158c-4509-beaa-4e831729fdad tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] 10.222.0.26 "GET /compute/v2.1/servers/ca6cb405-f00a-4fcf-9147-824793f35ebf" status: 200 len: 1445 microversion: 2.1 time: 0.227394 Mar 05 02:55:13.531895 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 210/433] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:55:13 2022] GET /compute/v2.1/servers/ca6cb405-f00a-4fcf-9147-824793f35ebf => generated 1445 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 02:55:13.535515 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-7bbd44e8-a217-45cb-84fb-ef9015b3b11b tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:55:13.536332 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [req-af936c19-d220-465e-9fbc-728a54cf7246 req-a4034b85-fe31-488a-9bd1-a824166c4dfe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e28e570d-3d50-4fe8-bb4a-fe0e95c20fb7", "name": "network-vif-plugged", "status": "completed", "tag": "f280dd1a-3e15-49a1-9569-b6b40278e2a2"}]} {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 02:55:13.537007 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-7bbd44e8-a217-45cb-84fb-ef9015b3b11b tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:55:13.538187 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-7bbd44e8-a217-45cb-84fb-ef9015b3b11b tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] 10.222.0.26 "GET /compute/v2.1/servers/e28e570d-3d50-4fe8-bb4a-fe0e95c20fb7" status: 200 len: 1808 microversion: 2.20 time: 0.214150 Mar 05 02:55:13.538898 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 224/434] 10.222.0.26 () {60 vars in 1276 bytes} [Sat Mar 5 02:55:13 2022] GET /compute/v2.1/servers/e28e570d-3d50-4fe8-bb4a-fe0e95c20fb7 => generated 1808 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 02:55:13.544745 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [req-af936c19-d220-465e-9fbc-728a54cf7246 req-a4034b85-fe31-488a-9bd1-a824166c4dfe service nova] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:55:13.545380 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [req-af936c19-d220-465e-9fbc-728a54cf7246 req-a4034b85-fe31-488a-9bd1-a824166c4dfe service nova] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:55:13.557925 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.compute.server_external_events [req-af936c19-d220-465e-9fbc-728a54cf7246 req-a4034b85-fe31-488a-9bd1-a824166c4dfe service nova] Creating event network-vif-plugged:f280dd1a-3e15-49a1-9569-b6b40278e2a2 for instance e28e570d-3d50-4fe8-bb4a-fe0e95c20fb7 on hv-cinder-82725 Mar 05 02:55:13.563559 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [req-af936c19-d220-465e-9fbc-728a54cf7246 req-a4034b85-fe31-488a-9bd1-a824166c4dfe service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030574 Mar 05 02:55:13.564174 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 211/435] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Mar 5 02:55:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 02:55:14.046490 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-1ed7d625-ad47-4b00-a9a1-bac8f220dd42 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:55:14.047157 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-1ed7d625-ad47-4b00-a9a1-bac8f220dd42 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] [instance: c24fee69-5bf4-40f4-ba18-56aecd12dd96] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:55:14.054188 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-1ed7d625-ad47-4b00-a9a1-bac8f220dd42 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:55:14.054648 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-1ed7d625-ad47-4b00-a9a1-bac8f220dd42 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:55:14.055496 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-1ed7d625-ad47-4b00-a9a1-bac8f220dd42 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:55:14.055940 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-1ed7d625-ad47-4b00-a9a1-bac8f220dd42 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:55:14.085187 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-1ed7d625-ad47-4b00-a9a1-bac8f220dd42 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] 10.222.0.26 "GET /compute/v2.1/servers/c24fee69-5bf4-40f4-ba18-56aecd12dd96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043878 Mar 05 02:55:14.089120 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 225/436] 10.222.0.26 () {58 vars in 1301 bytes} [Sat Mar 5 02:55:14 2022] GET /compute/v2.1/servers/c24fee69-5bf4-40f4-ba18-56aecd12dd96/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 02:55:14.557742 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-d4328ae9-a60e-4181-b0a3-810d170eaaca tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:55:14.558508 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-d4328ae9-a60e-4181-b0a3-810d170eaaca tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] [instance: e28e570d-3d50-4fe8-bb4a-fe0e95c20fb7] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:55:14.564762 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-d4328ae9-a60e-4181-b0a3-810d170eaaca tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:55:14.565223 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-d4328ae9-a60e-4181-b0a3-810d170eaaca tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:55:14.566025 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-d4328ae9-a60e-4181-b0a3-810d170eaaca tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:55:14.566474 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-d4328ae9-a60e-4181-b0a3-810d170eaaca tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:55:14.796523 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-d4328ae9-a60e-4181-b0a3-810d170eaaca tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:55:14.806416 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-d4328ae9-a60e-4181-b0a3-810d170eaaca tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:55:14.807929 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-d4328ae9-a60e-4181-b0a3-810d170eaaca tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:55:14.809130 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-d4328ae9-a60e-4181-b0a3-810d170eaaca tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] 10.222.0.26 "GET /compute/v2.1/servers/e28e570d-3d50-4fe8-bb4a-fe0e95c20fb7" status: 200 len: 1808 microversion: 2.20 time: 0.256219 Mar 05 02:55:14.810286 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 212/437] 10.222.0.26 () {60 vars in 1276 bytes} [Sat Mar 5 02:55:14 2022] GET /compute/v2.1/servers/e28e570d-3d50-4fe8-bb4a-fe0e95c20fb7 => generated 1808 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 05 02:55:15.097516 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-700d4205-ceba-4350-8863-8d4fa4d16580 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:55:15.098544 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-700d4205-ceba-4350-8863-8d4fa4d16580 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] [instance: c24fee69-5bf4-40f4-ba18-56aecd12dd96] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:55:15.105065 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-700d4205-ceba-4350-8863-8d4fa4d16580 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:55:15.105588 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-700d4205-ceba-4350-8863-8d4fa4d16580 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:55:15.106642 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-700d4205-ceba-4350-8863-8d4fa4d16580 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:55:15.107091 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-700d4205-ceba-4350-8863-8d4fa4d16580 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:55:15.134804 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-700d4205-ceba-4350-8863-8d4fa4d16580 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] 10.222.0.26 "GET /compute/v2.1/servers/c24fee69-5bf4-40f4-ba18-56aecd12dd96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041260 Mar 05 02:55:15.135437 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 226/438] 10.222.0.26 () {58 vars in 1301 bytes} [Sat Mar 5 02:55:15 2022] GET /compute/v2.1/servers/c24fee69-5bf4-40f4-ba18-56aecd12dd96/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 02:55:15.807416 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [req-524a99f5-c720-4b04-bc25-5ae2fd83ac2d req-fc16ea1d-4313-47fb-bf14-9a72015d1f57 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ca6cb405-f00a-4fcf-9147-824793f35ebf", "tag": "6c993446-3f76-4f92-94ad-2054b8a5ebfe"}]} {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 02:55:15.816396 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [req-524a99f5-c720-4b04-bc25-5ae2fd83ac2d req-fc16ea1d-4313-47fb-bf14-9a72015d1f57 service nova] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:55:15.816844 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [req-524a99f5-c720-4b04-bc25-5ae2fd83ac2d req-fc16ea1d-4313-47fb-bf14-9a72015d1f57 service nova] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:55:15.828824 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.compute.server_external_events [req-524a99f5-c720-4b04-bc25-5ae2fd83ac2d req-fc16ea1d-4313-47fb-bf14-9a72015d1f57 service nova] Creating event network-changed:6c993446-3f76-4f92-94ad-2054b8a5ebfe for instance ca6cb405-f00a-4fcf-9147-824793f35ebf on hv-cinder-82725 Mar 05 02:55:15.829273 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-99a1e114-d575-484a-8f5d-9dc350d3682c tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:55:15.830046 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-99a1e114-d575-484a-8f5d-9dc350d3682c tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] [instance: e28e570d-3d50-4fe8-bb4a-fe0e95c20fb7] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:55:15.833754 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [req-524a99f5-c720-4b04-bc25-5ae2fd83ac2d req-fc16ea1d-4313-47fb-bf14-9a72015d1f57 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030063 Mar 05 02:55:15.834686 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 213/439] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Mar 5 02:55:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 02:55:15.839706 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-99a1e114-d575-484a-8f5d-9dc350d3682c tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:55:15.840221 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-99a1e114-d575-484a-8f5d-9dc350d3682c tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:55:15.841058 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-99a1e114-d575-484a-8f5d-9dc350d3682c tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:55:15.841500 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-99a1e114-d575-484a-8f5d-9dc350d3682c tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:55:16.093808 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-99a1e114-d575-484a-8f5d-9dc350d3682c tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:55:16.103098 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-99a1e114-d575-484a-8f5d-9dc350d3682c tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:55:16.105494 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-99a1e114-d575-484a-8f5d-9dc350d3682c tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:55:16.107770 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-99a1e114-d575-484a-8f5d-9dc350d3682c tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] 10.222.0.26 "GET /compute/v2.1/servers/e28e570d-3d50-4fe8-bb4a-fe0e95c20fb7" status: 200 len: 1808 microversion: 2.20 time: 0.283104 Mar 05 02:55:16.108506 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 227/440] 10.222.0.26 () {60 vars in 1276 bytes} [Sat Mar 5 02:55:15 2022] GET /compute/v2.1/servers/e28e570d-3d50-4fe8-bb4a-fe0e95c20fb7 => generated 1808 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 05 02:55:16.147655 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-036e921c-7711-4b28-b770-5c82b56ed109 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:55:16.148630 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-036e921c-7711-4b28-b770-5c82b56ed109 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] [instance: c24fee69-5bf4-40f4-ba18-56aecd12dd96] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:55:16.156089 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-036e921c-7711-4b28-b770-5c82b56ed109 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:55:16.156546 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-036e921c-7711-4b28-b770-5c82b56ed109 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:55:16.157330 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-036e921c-7711-4b28-b770-5c82b56ed109 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:55:16.157766 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-036e921c-7711-4b28-b770-5c82b56ed109 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:55:16.189117 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-036e921c-7711-4b28-b770-5c82b56ed109 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] 10.222.0.26 "GET /compute/v2.1/servers/c24fee69-5bf4-40f4-ba18-56aecd12dd96/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045795 Mar 05 02:55:16.189685 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 214/441] 10.222.0.26 () {58 vars in 1301 bytes} [Sat Mar 5 02:55:16 2022] GET /compute/v2.1/servers/c24fee69-5bf4-40f4-ba18-56aecd12dd96/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 05 02:55:17.128016 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-6113f09e-3762-455b-9d80-e4bee8ac2ce7 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:55:17.128625 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-6113f09e-3762-455b-9d80-e4bee8ac2ce7 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] [instance: e28e570d-3d50-4fe8-bb4a-fe0e95c20fb7] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:55:17.135215 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-6113f09e-3762-455b-9d80-e4bee8ac2ce7 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:55:17.135668 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-6113f09e-3762-455b-9d80-e4bee8ac2ce7 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:55:17.136434 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-6113f09e-3762-455b-9d80-e4bee8ac2ce7 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:55:17.136863 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-6113f09e-3762-455b-9d80-e4bee8ac2ce7 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:55:17.272120 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-6113f09e-3762-455b-9d80-e4bee8ac2ce7 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:55:17.280687 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-6113f09e-3762-455b-9d80-e4bee8ac2ce7 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:55:17.282224 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-6113f09e-3762-455b-9d80-e4bee8ac2ce7 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:55:17.283374 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-6113f09e-3762-455b-9d80-e4bee8ac2ce7 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] 10.222.0.26 "GET /compute/v2.1/servers/e28e570d-3d50-4fe8-bb4a-fe0e95c20fb7" status: 200 len: 1808 microversion: 2.20 time: 0.159385 Mar 05 02:55:17.283931 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 228/442] 10.222.0.26 () {60 vars in 1276 bytes} [Sat Mar 5 02:55:17 2022] GET /compute/v2.1/servers/e28e570d-3d50-4fe8-bb4a-fe0e95c20fb7 => generated 1808 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 02:55:18.301797 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-21b8cf2c-dbc1-4e17-9b38-c79005918a4c tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:55:18.302418 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-21b8cf2c-dbc1-4e17-9b38-c79005918a4c tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] [instance: e28e570d-3d50-4fe8-bb4a-fe0e95c20fb7] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:55:18.308653 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-21b8cf2c-dbc1-4e17-9b38-c79005918a4c tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:55:18.309097 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-21b8cf2c-dbc1-4e17-9b38-c79005918a4c tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:55:18.309903 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-21b8cf2c-dbc1-4e17-9b38-c79005918a4c tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:55:18.310359 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-21b8cf2c-dbc1-4e17-9b38-c79005918a4c tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:55:18.443076 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-21b8cf2c-dbc1-4e17-9b38-c79005918a4c tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:55:18.451846 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-21b8cf2c-dbc1-4e17-9b38-c79005918a4c tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:55:18.453338 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-21b8cf2c-dbc1-4e17-9b38-c79005918a4c tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:55:18.454529 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-21b8cf2c-dbc1-4e17-9b38-c79005918a4c tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] 10.222.0.26 "GET /compute/v2.1/servers/e28e570d-3d50-4fe8-bb4a-fe0e95c20fb7" status: 200 len: 1808 microversion: 2.20 time: 0.156628 Mar 05 02:55:18.455084 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 215/443] 10.222.0.26 () {60 vars in 1276 bytes} [Sat Mar 5 02:55:18 2022] GET /compute/v2.1/servers/e28e570d-3d50-4fe8-bb4a-fe0e95c20fb7 => generated 1808 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 02:55:19.473116 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-03655864-868b-47e0-93ea-99b3195b8d96 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:55:19.473722 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-03655864-868b-47e0-93ea-99b3195b8d96 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] [instance: e28e570d-3d50-4fe8-bb4a-fe0e95c20fb7] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:55:19.480586 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-03655864-868b-47e0-93ea-99b3195b8d96 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:55:19.481843 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-03655864-868b-47e0-93ea-99b3195b8d96 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:55:19.482619 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-03655864-868b-47e0-93ea-99b3195b8d96 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:55:19.483059 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-03655864-868b-47e0-93ea-99b3195b8d96 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:55:19.618192 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-03655864-868b-47e0-93ea-99b3195b8d96 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:55:19.626600 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-03655864-868b-47e0-93ea-99b3195b8d96 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:55:19.628091 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-03655864-868b-47e0-93ea-99b3195b8d96 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:55:19.629222 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-03655864-868b-47e0-93ea-99b3195b8d96 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] 10.222.0.26 "GET /compute/v2.1/servers/e28e570d-3d50-4fe8-bb4a-fe0e95c20fb7" status: 200 len: 1795 microversion: 2.20 time: 0.160155 Mar 05 02:55:19.629775 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 229/444] 10.222.0.26 () {60 vars in 1276 bytes} [Sat Mar 5 02:55:19 2022] GET /compute/v2.1/servers/e28e570d-3d50-4fe8-bb4a-fe0e95c20fb7 => generated 1795 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 02:55:20.623721 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-95fbab5c-2394-4c34-aca6-4d5fddf4583e tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:55:20.624271 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-95fbab5c-2394-4c34-aca6-4d5fddf4583e tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] [instance: 39e14280-8730-41d3-993e-a158f0029386] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:55:20.630551 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-95fbab5c-2394-4c34-aca6-4d5fddf4583e tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:55:20.630997 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-95fbab5c-2394-4c34-aca6-4d5fddf4583e tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:55:20.631760 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-95fbab5c-2394-4c34-aca6-4d5fddf4583e tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:55:20.632193 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-95fbab5c-2394-4c34-aca6-4d5fddf4583e tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:55:20.655336 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-95fbab5c-2394-4c34-aca6-4d5fddf4583e tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] [instance: 39e14280-8730-41d3-993e-a158f0029386] Going to try to terminate instance {{(pid=123546) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 05 02:55:20.729125 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-95fbab5c-2394-4c34-aca6-4d5fddf4583e tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] 10.222.0.26 "DELETE /compute/v2.1/servers/39e14280-8730-41d3-993e-a158f0029386" status: 204 len: 0 microversion: 2.1 time: 0.109228 Mar 05 02:55:20.729857 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 216/445] 10.222.0.26 () {58 vars in 1238 bytes} [Sat Mar 5 02:55:20 2022] DELETE /compute/v2.1/servers/39e14280-8730-41d3-993e-a158f0029386 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 05 02:55:20.738906 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-45719191-8efe-4372-8807-02a487355287 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:55:20.739511 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-45719191-8efe-4372-8807-02a487355287 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] [instance: 39e14280-8730-41d3-993e-a158f0029386] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:55:20.746191 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-45719191-8efe-4372-8807-02a487355287 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:55:20.746901 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-45719191-8efe-4372-8807-02a487355287 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:55:20.747450 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-45719191-8efe-4372-8807-02a487355287 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:55:20.747895 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-45719191-8efe-4372-8807-02a487355287 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:55:20.885288 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-45719191-8efe-4372-8807-02a487355287 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90033e5e8e634b699bf050e36519f8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8112a5759c444c1f94be24ab61bf072f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:55:20.892788 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-45719191-8efe-4372-8807-02a487355287 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] 10.222.0.26 "GET /compute/v2.1/servers/39e14280-8730-41d3-993e-a158f0029386" status: 200 len: 1508 microversion: 2.1 time: 0.158060 Mar 05 02:55:20.893351 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 230/446] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:55:20 2022] GET /compute/v2.1/servers/39e14280-8730-41d3-993e-a158f0029386 => generated 1508 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 02:55:21.911688 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-fb6b7cd6-a31b-4d82-97bc-d30aea766445 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:55:21.912383 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-fb6b7cd6-a31b-4d82-97bc-d30aea766445 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] [instance: 39e14280-8730-41d3-993e-a158f0029386] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:55:21.919484 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-fb6b7cd6-a31b-4d82-97bc-d30aea766445 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:55:21.919923 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-fb6b7cd6-a31b-4d82-97bc-d30aea766445 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:55:21.925866 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-fb6b7cd6-a31b-4d82-97bc-d30aea766445 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:55:21.926412 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-fb6b7cd6-a31b-4d82-97bc-d30aea766445 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:55:22.070175 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-fb6b7cd6-a31b-4d82-97bc-d30aea766445 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90033e5e8e634b699bf050e36519f8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8112a5759c444c1f94be24ab61bf072f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:55:22.078305 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-fb6b7cd6-a31b-4d82-97bc-d30aea766445 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] 10.222.0.26 "GET /compute/v2.1/servers/39e14280-8730-41d3-993e-a158f0029386" status: 200 len: 1508 microversion: 2.1 time: 0.170804 Mar 05 02:55:22.078875 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 217/447] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:55:21 2022] GET /compute/v2.1/servers/39e14280-8730-41d3-993e-a158f0029386 => generated 1508 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 02:55:23.095161 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-421a522c-4d73-4979-97b0-fa3391b51e18 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:55:23.095762 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-421a522c-4d73-4979-97b0-fa3391b51e18 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] [instance: 39e14280-8730-41d3-993e-a158f0029386] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:55:23.102031 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-421a522c-4d73-4979-97b0-fa3391b51e18 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:55:23.102482 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-421a522c-4d73-4979-97b0-fa3391b51e18 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:55:23.103237 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-421a522c-4d73-4979-97b0-fa3391b51e18 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:55:23.103664 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-421a522c-4d73-4979-97b0-fa3391b51e18 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:55:23.236595 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-421a522c-4d73-4979-97b0-fa3391b51e18 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90033e5e8e634b699bf050e36519f8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8112a5759c444c1f94be24ab61bf072f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:55:23.244144 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-421a522c-4d73-4979-97b0-fa3391b51e18 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] 10.222.0.26 "GET /compute/v2.1/servers/39e14280-8730-41d3-993e-a158f0029386" status: 200 len: 1508 microversion: 2.1 time: 0.152846 Mar 05 02:55:23.244757 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 231/448] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:55:23 2022] GET /compute/v2.1/servers/39e14280-8730-41d3-993e-a158f0029386 => generated 1508 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 02:55:24.260497 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-f970ca8a-f059-4a19-aece-faa2e968fbd4 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:55:24.261136 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-f970ca8a-f059-4a19-aece-faa2e968fbd4 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] [instance: 39e14280-8730-41d3-993e-a158f0029386] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:55:24.268134 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-f970ca8a-f059-4a19-aece-faa2e968fbd4 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:55:24.268582 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-f970ca8a-f059-4a19-aece-faa2e968fbd4 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:55:24.269349 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-f970ca8a-f059-4a19-aece-faa2e968fbd4 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:55:24.269784 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-f970ca8a-f059-4a19-aece-faa2e968fbd4 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:55:24.400110 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-f970ca8a-f059-4a19-aece-faa2e968fbd4 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90033e5e8e634b699bf050e36519f8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8112a5759c444c1f94be24ab61bf072f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:55:24.407983 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-f970ca8a-f059-4a19-aece-faa2e968fbd4 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] 10.222.0.26 "GET /compute/v2.1/servers/39e14280-8730-41d3-993e-a158f0029386" status: 200 len: 1508 microversion: 2.1 time: 0.151321 Mar 05 02:55:24.408551 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 218/449] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:55:24 2022] GET /compute/v2.1/servers/39e14280-8730-41d3-993e-a158f0029386 => generated 1508 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 02:55:25.425126 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-4f96d622-8c79-46a7-9c85-681ed31a432c tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:55:25.425736 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-4f96d622-8c79-46a7-9c85-681ed31a432c tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] [instance: 39e14280-8730-41d3-993e-a158f0029386] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:55:25.431986 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-4f96d622-8c79-46a7-9c85-681ed31a432c tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:55:25.432437 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-4f96d622-8c79-46a7-9c85-681ed31a432c tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:55:25.433203 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-4f96d622-8c79-46a7-9c85-681ed31a432c tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:55:25.433638 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-4f96d622-8c79-46a7-9c85-681ed31a432c tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:55:25.564014 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-4f96d622-8c79-46a7-9c85-681ed31a432c tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90033e5e8e634b699bf050e36519f8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8112a5759c444c1f94be24ab61bf072f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:55:25.571130 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-4f96d622-8c79-46a7-9c85-681ed31a432c tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] 10.222.0.26 "GET /compute/v2.1/servers/39e14280-8730-41d3-993e-a158f0029386" status: 200 len: 1508 microversion: 2.1 time: 0.149867 Mar 05 02:55:25.571697 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 232/450] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:55:25 2022] GET /compute/v2.1/servers/39e14280-8730-41d3-993e-a158f0029386 => generated 1508 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 02:55:26.586842 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-0d5977c9-8692-4eb8-89e4-dcce12579898 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:55:26.587356 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-0d5977c9-8692-4eb8-89e4-dcce12579898 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] [instance: 39e14280-8730-41d3-993e-a158f0029386] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:55:26.593791 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-0d5977c9-8692-4eb8-89e4-dcce12579898 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:55:26.594266 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-0d5977c9-8692-4eb8-89e4-dcce12579898 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:55:26.595019 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-0d5977c9-8692-4eb8-89e4-dcce12579898 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:55:26.595450 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-0d5977c9-8692-4eb8-89e4-dcce12579898 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:55:26.728418 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-0d5977c9-8692-4eb8-89e4-dcce12579898 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90033e5e8e634b699bf050e36519f8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8112a5759c444c1f94be24ab61bf072f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:55:26.736265 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-0d5977c9-8692-4eb8-89e4-dcce12579898 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] 10.222.0.26 "GET /compute/v2.1/servers/39e14280-8730-41d3-993e-a158f0029386" status: 200 len: 1508 microversion: 2.1 time: 0.153164 Mar 05 02:55:26.736743 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 219/451] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:55:26 2022] GET /compute/v2.1/servers/39e14280-8730-41d3-993e-a158f0029386 => generated 1508 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 02:55:27.753588 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-db709e1f-c565-45a0-b4a5-57048a4dbc01 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:55:27.754222 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-db709e1f-c565-45a0-b4a5-57048a4dbc01 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] [instance: 39e14280-8730-41d3-993e-a158f0029386] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:55:27.760437 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-db709e1f-c565-45a0-b4a5-57048a4dbc01 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:55:27.760880 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-db709e1f-c565-45a0-b4a5-57048a4dbc01 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:55:27.761663 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-db709e1f-c565-45a0-b4a5-57048a4dbc01 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:55:27.762726 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-db709e1f-c565-45a0-b4a5-57048a4dbc01 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:55:27.901601 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-db709e1f-c565-45a0-b4a5-57048a4dbc01 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90033e5e8e634b699bf050e36519f8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8112a5759c444c1f94be24ab61bf072f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:55:27.909065 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-db709e1f-c565-45a0-b4a5-57048a4dbc01 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] 10.222.0.26 "GET /compute/v2.1/servers/39e14280-8730-41d3-993e-a158f0029386" status: 200 len: 1508 microversion: 2.1 time: 0.159390 Mar 05 02:55:27.909628 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 233/452] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:55:27 2022] GET /compute/v2.1/servers/39e14280-8730-41d3-993e-a158f0029386 => generated 1508 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 02:55:28.372104 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [req-d2a57614-032c-420d-8ab1-2b98a775e9cc req-970cbf17-9ab1-403e-b57d-33043376980b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39e14280-8730-41d3-993e-a158f0029386", "name": "network-vif-deleted", "tag": "8647369d-1b5f-487f-be9a-cd16b07bda62"}]} {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 02:55:28.381094 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [req-d2a57614-032c-420d-8ab1-2b98a775e9cc req-970cbf17-9ab1-403e-b57d-33043376980b service nova] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:55:28.381797 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [req-d2a57614-032c-420d-8ab1-2b98a775e9cc req-970cbf17-9ab1-403e-b57d-33043376980b service nova] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:55:28.394254 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.compute.server_external_events [req-d2a57614-032c-420d-8ab1-2b98a775e9cc req-970cbf17-9ab1-403e-b57d-33043376980b service nova] Creating event network-vif-deleted:8647369d-1b5f-487f-be9a-cd16b07bda62 for instance 39e14280-8730-41d3-993e-a158f0029386 on hv-cinder-82725 Mar 05 02:55:28.399497 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [req-d2a57614-032c-420d-8ab1-2b98a775e9cc req-970cbf17-9ab1-403e-b57d-33043376980b service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031474 Mar 05 02:55:28.400180 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 220/453] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Mar 5 02:55:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 02:55:28.926064 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-09cb367f-fbdb-4dd7-afaf-3e1f160bebfa tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:55:28.926676 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-09cb367f-fbdb-4dd7-afaf-3e1f160bebfa tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] [instance: 39e14280-8730-41d3-993e-a158f0029386] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:55:28.932929 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-09cb367f-fbdb-4dd7-afaf-3e1f160bebfa tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:55:28.933317 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-09cb367f-fbdb-4dd7-afaf-3e1f160bebfa tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:55:28.934712 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-09cb367f-fbdb-4dd7-afaf-3e1f160bebfa tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:55:28.935153 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-09cb367f-fbdb-4dd7-afaf-3e1f160bebfa tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:55:28.967809 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-09cb367f-fbdb-4dd7-afaf-3e1f160bebfa tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:55:28.968268 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-09cb367f-fbdb-4dd7-afaf-3e1f160bebfa tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:55:28.968717 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.objects.instance [None req-09cb367f-fbdb-4dd7-afaf-3e1f160bebfa tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lazy-loading 'fault' on Instance uuid 39e14280-8730-41d3-993e-a158f0029386 {{(pid=123545) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 05 02:55:29.008992 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-09cb367f-fbdb-4dd7-afaf-3e1f160bebfa tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90033e5e8e634b699bf050e36519f8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8112a5759c444c1f94be24ab61bf072f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:55:29.015868 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-09cb367f-fbdb-4dd7-afaf-3e1f160bebfa tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] 10.222.0.26 "GET /compute/v2.1/servers/39e14280-8730-41d3-993e-a158f0029386" status: 200 len: 1312 microversion: 2.1 time: 0.093823 Mar 05 02:55:29.016441 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 234/454] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:55:28 2022] GET /compute/v2.1/servers/39e14280-8730-41d3-993e-a158f0029386 => generated 1312 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 02:55:30.033577 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-a3221e0e-6abf-4b6f-a1bb-88a71a8d119e tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:55:30.034293 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-a3221e0e-6abf-4b6f-a1bb-88a71a8d119e tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] [instance: 39e14280-8730-41d3-993e-a158f0029386] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:55:30.040645 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-a3221e0e-6abf-4b6f-a1bb-88a71a8d119e tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:55:30.041091 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-a3221e0e-6abf-4b6f-a1bb-88a71a8d119e tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:55:30.041842 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-a3221e0e-6abf-4b6f-a1bb-88a71a8d119e tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:55:30.042298 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-a3221e0e-6abf-4b6f-a1bb-88a71a8d119e tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:55:30.056841 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.wsgi [None req-a3221e0e-6abf-4b6f-a1bb-88a71a8d119e tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] HTTP exception thrown: Instance 39e14280-8730-41d3-993e-a158f0029386 could not be found. Mar 05 02:55:30.057411 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-a3221e0e-6abf-4b6f-a1bb-88a71a8d119e tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Returning 404 to user: Instance 39e14280-8730-41d3-993e-a158f0029386 could not be found. {{(pid=123546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 02:55:30.058246 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-a3221e0e-6abf-4b6f-a1bb-88a71a8d119e tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] 10.222.0.26 "GET /compute/v2.1/servers/39e14280-8730-41d3-993e-a158f0029386" status: 404 len: 111 microversion: 2.1 time: 0.029502 Mar 05 02:55:30.059368 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 221/455] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:55:30 2022] GET /compute/v2.1/servers/39e14280-8730-41d3-993e-a158f0029386 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 05 02:55:30.067929 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-2cf2d1fd-788f-4626-bb8a-66934ff03cb3 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:55:30.067929 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-2cf2d1fd-788f-4626-bb8a-66934ff03cb3 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] [instance: c24fee69-5bf4-40f4-ba18-56aecd12dd96] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:55:30.073888 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-2cf2d1fd-788f-4626-bb8a-66934ff03cb3 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:55:30.074367 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-2cf2d1fd-788f-4626-bb8a-66934ff03cb3 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:55:30.075674 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-2cf2d1fd-788f-4626-bb8a-66934ff03cb3 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:55:30.076080 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-2cf2d1fd-788f-4626-bb8a-66934ff03cb3 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:55:30.111605 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-2cf2d1fd-788f-4626-bb8a-66934ff03cb3 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] [instance: c24fee69-5bf4-40f4-ba18-56aecd12dd96] Going to try to terminate instance {{(pid=123545) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 05 02:55:30.182236 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-2cf2d1fd-788f-4626-bb8a-66934ff03cb3 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] 10.222.0.26 "DELETE /compute/v2.1/servers/c24fee69-5bf4-40f4-ba18-56aecd12dd96" status: 204 len: 0 microversion: 2.1 time: 0.118433 Mar 05 02:55:30.182849 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 235/456] 10.222.0.26 () {58 vars in 1238 bytes} [Sat Mar 5 02:55:30 2022] DELETE /compute/v2.1/servers/c24fee69-5bf4-40f4-ba18-56aecd12dd96 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 05 02:55:30.191229 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-321b98e0-ebd5-4868-b096-bb69d33ab72e tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:55:30.191959 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-321b98e0-ebd5-4868-b096-bb69d33ab72e tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] [instance: c24fee69-5bf4-40f4-ba18-56aecd12dd96] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:55:30.197857 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-321b98e0-ebd5-4868-b096-bb69d33ab72e tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:55:30.198352 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-321b98e0-ebd5-4868-b096-bb69d33ab72e tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:55:30.199100 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-321b98e0-ebd5-4868-b096-bb69d33ab72e tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:55:30.200074 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-321b98e0-ebd5-4868-b096-bb69d33ab72e tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:55:30.329758 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-321b98e0-ebd5-4868-b096-bb69d33ab72e tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90033e5e8e634b699bf050e36519f8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8112a5759c444c1f94be24ab61bf072f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:55:30.337041 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-321b98e0-ebd5-4868-b096-bb69d33ab72e tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] 10.222.0.26 "GET /compute/v2.1/servers/c24fee69-5bf4-40f4-ba18-56aecd12dd96" status: 200 len: 1520 microversion: 2.1 time: 0.149788 Mar 05 02:55:30.337602 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 222/457] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:55:30 2022] GET /compute/v2.1/servers/c24fee69-5bf4-40f4-ba18-56aecd12dd96 => generated 1520 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 02:55:31.355177 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-a89625ee-1cb5-45d7-a5e2-8e55cc84fae4 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:55:31.356906 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-a89625ee-1cb5-45d7-a5e2-8e55cc84fae4 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] [instance: c24fee69-5bf4-40f4-ba18-56aecd12dd96] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:55:31.363174 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-a89625ee-1cb5-45d7-a5e2-8e55cc84fae4 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:55:31.363623 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-a89625ee-1cb5-45d7-a5e2-8e55cc84fae4 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:55:31.364384 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-a89625ee-1cb5-45d7-a5e2-8e55cc84fae4 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:55:31.364817 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-a89625ee-1cb5-45d7-a5e2-8e55cc84fae4 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:55:31.500744 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-a89625ee-1cb5-45d7-a5e2-8e55cc84fae4 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90033e5e8e634b699bf050e36519f8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8112a5759c444c1f94be24ab61bf072f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:55:31.507984 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-a89625ee-1cb5-45d7-a5e2-8e55cc84fae4 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] 10.222.0.26 "GET /compute/v2.1/servers/c24fee69-5bf4-40f4-ba18-56aecd12dd96" status: 200 len: 1520 microversion: 2.1 time: 0.157299 Mar 05 02:55:31.508543 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 236/458] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:55:31 2022] GET /compute/v2.1/servers/c24fee69-5bf4-40f4-ba18-56aecd12dd96 => generated 1520 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 02:55:31.658926 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-15c21653-0457-44c1-95ec-9ed89d53c974 tempest-VolumesSnapshotTestJSON-729970751 tempest-VolumesSnapshotTestJSON-729970751-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:55:31.659422 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-15c21653-0457-44c1-95ec-9ed89d53c974 tempest-VolumesSnapshotTestJSON-729970751 tempest-VolumesSnapshotTestJSON-729970751-project] [instance: b89e62f7-7ccc-48a6-ad76-88f6e022fe95] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:55:31.665613 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-15c21653-0457-44c1-95ec-9ed89d53c974 tempest-VolumesSnapshotTestJSON-729970751 tempest-VolumesSnapshotTestJSON-729970751-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:55:31.666098 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-15c21653-0457-44c1-95ec-9ed89d53c974 tempest-VolumesSnapshotTestJSON-729970751 tempest-VolumesSnapshotTestJSON-729970751-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:55:31.666856 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-15c21653-0457-44c1-95ec-9ed89d53c974 tempest-VolumesSnapshotTestJSON-729970751 tempest-VolumesSnapshotTestJSON-729970751-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:55:31.667319 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-15c21653-0457-44c1-95ec-9ed89d53c974 tempest-VolumesSnapshotTestJSON-729970751 tempest-VolumesSnapshotTestJSON-729970751-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:55:31.751821 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.objects.instance [None req-15c21653-0457-44c1-95ec-9ed89d53c974 tempest-VolumesSnapshotTestJSON-729970751 tempest-VolumesSnapshotTestJSON-729970751-project] Lazy-loading 'services' on Instance uuid b89e62f7-7ccc-48a6-ad76-88f6e022fe95 {{(pid=123546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 05 02:55:31.861235 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-15c21653-0457-44c1-95ec-9ed89d53c974 tempest-VolumesSnapshotTestJSON-729970751 tempest-VolumesSnapshotTestJSON-729970751-project] 10.222.0.26 "DELETE /compute/v2.1/servers/b89e62f7-7ccc-48a6-ad76-88f6e022fe95/os-volume_attachments/ca67d8ea-b943-4a3c-bc74-d3ecfe5c2fe6" status: 202 len: 0 microversion: 2.1 time: 0.205853 Mar 05 02:55:31.861896 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 223/459] 10.222.0.26 () {58 vars in 1415 bytes} [Sat Mar 5 02:55:31 2022] DELETE /compute/v2.1/servers/b89e62f7-7ccc-48a6-ad76-88f6e022fe95/os-volume_attachments/ca67d8ea-b943-4a3c-bc74-d3ecfe5c2fe6 => generated 0 bytes in 207 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 05 02:55:32.523954 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-455dd854-a431-453a-b8e8-6aab16e5a928 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:55:32.524566 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-455dd854-a431-453a-b8e8-6aab16e5a928 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] [instance: c24fee69-5bf4-40f4-ba18-56aecd12dd96] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:55:32.532198 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-455dd854-a431-453a-b8e8-6aab16e5a928 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:55:32.532702 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-455dd854-a431-453a-b8e8-6aab16e5a928 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:55:32.533672 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-455dd854-a431-453a-b8e8-6aab16e5a928 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:55:32.534300 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-455dd854-a431-453a-b8e8-6aab16e5a928 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:55:32.666591 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-455dd854-a431-453a-b8e8-6aab16e5a928 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90033e5e8e634b699bf050e36519f8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8112a5759c444c1f94be24ab61bf072f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:55:32.673832 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-455dd854-a431-453a-b8e8-6aab16e5a928 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] 10.222.0.26 "GET /compute/v2.1/servers/c24fee69-5bf4-40f4-ba18-56aecd12dd96" status: 200 len: 1520 microversion: 2.1 time: 0.153704 Mar 05 02:55:32.675836 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 237/460] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:55:32 2022] GET /compute/v2.1/servers/c24fee69-5bf4-40f4-ba18-56aecd12dd96 => generated 1520 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 02:55:32.975799 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-413f9962-b83f-47aa-9658-efe409a7b187 tempest-VolumesSnapshotTestJSON-729970751 tempest-VolumesSnapshotTestJSON-729970751-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:55:32.976386 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-413f9962-b83f-47aa-9658-efe409a7b187 tempest-VolumesSnapshotTestJSON-729970751 tempest-VolumesSnapshotTestJSON-729970751-project] [instance: b89e62f7-7ccc-48a6-ad76-88f6e022fe95] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:55:32.982956 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-413f9962-b83f-47aa-9658-efe409a7b187 tempest-VolumesSnapshotTestJSON-729970751 tempest-VolumesSnapshotTestJSON-729970751-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:55:32.983403 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-413f9962-b83f-47aa-9658-efe409a7b187 tempest-VolumesSnapshotTestJSON-729970751 tempest-VolumesSnapshotTestJSON-729970751-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:55:32.984172 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-413f9962-b83f-47aa-9658-efe409a7b187 tempest-VolumesSnapshotTestJSON-729970751 tempest-VolumesSnapshotTestJSON-729970751-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:55:32.984607 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-413f9962-b83f-47aa-9658-efe409a7b187 tempest-VolumesSnapshotTestJSON-729970751 tempest-VolumesSnapshotTestJSON-729970751-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:55:33.008411 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-413f9962-b83f-47aa-9658-efe409a7b187 tempest-VolumesSnapshotTestJSON-729970751 tempest-VolumesSnapshotTestJSON-729970751-project] [instance: b89e62f7-7ccc-48a6-ad76-88f6e022fe95] Going to try to terminate instance {{(pid=123546) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 05 02:55:33.092541 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-413f9962-b83f-47aa-9658-efe409a7b187 tempest-VolumesSnapshotTestJSON-729970751 tempest-VolumesSnapshotTestJSON-729970751-project] 10.222.0.26 "DELETE /compute/v2.1/servers/b89e62f7-7ccc-48a6-ad76-88f6e022fe95" status: 204 len: 0 microversion: 2.1 time: 0.120833 Mar 05 02:55:33.092986 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 224/461] 10.222.0.26 () {58 vars in 1238 bytes} [Sat Mar 5 02:55:32 2022] DELETE /compute/v2.1/servers/b89e62f7-7ccc-48a6-ad76-88f6e022fe95 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 05 02:55:33.101175 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-69bd719f-defd-4c4f-8962-cc0d5bce2574 tempest-VolumesSnapshotTestJSON-729970751 tempest-VolumesSnapshotTestJSON-729970751-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:55:33.101935 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-69bd719f-defd-4c4f-8962-cc0d5bce2574 tempest-VolumesSnapshotTestJSON-729970751 tempest-VolumesSnapshotTestJSON-729970751-project] [instance: b89e62f7-7ccc-48a6-ad76-88f6e022fe95] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:55:33.109097 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-69bd719f-defd-4c4f-8962-cc0d5bce2574 tempest-VolumesSnapshotTestJSON-729970751 tempest-VolumesSnapshotTestJSON-729970751-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:55:33.109643 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-69bd719f-defd-4c4f-8962-cc0d5bce2574 tempest-VolumesSnapshotTestJSON-729970751 tempest-VolumesSnapshotTestJSON-729970751-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:55:33.110542 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-69bd719f-defd-4c4f-8962-cc0d5bce2574 tempest-VolumesSnapshotTestJSON-729970751 tempest-VolumesSnapshotTestJSON-729970751-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:55:33.111041 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-69bd719f-defd-4c4f-8962-cc0d5bce2574 tempest-VolumesSnapshotTestJSON-729970751 tempest-VolumesSnapshotTestJSON-729970751-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:55:33.248798 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-69bd719f-defd-4c4f-8962-cc0d5bce2574 tempest-VolumesSnapshotTestJSON-729970751 tempest-VolumesSnapshotTestJSON-729970751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84de0440c1444309d9c9b6c706bae73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8efa5f5dbc9f460aa91f4f62eb57abee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:55:33.259506 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-69bd719f-defd-4c4f-8962-cc0d5bce2574 tempest-VolumesSnapshotTestJSON-729970751 tempest-VolumesSnapshotTestJSON-729970751-project] 10.222.0.26 "GET /compute/v2.1/servers/b89e62f7-7ccc-48a6-ad76-88f6e022fe95" status: 200 len: 1512 microversion: 2.1 time: 0.162162 Mar 05 02:55:33.260123 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 238/462] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:55:33 2022] GET /compute/v2.1/servers/b89e62f7-7ccc-48a6-ad76-88f6e022fe95 => generated 1512 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 02:55:33.693116 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-3f6b9e51-bf42-4adb-8446-6ab3ae2907d4 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:55:33.693850 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-3f6b9e51-bf42-4adb-8446-6ab3ae2907d4 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] [instance: c24fee69-5bf4-40f4-ba18-56aecd12dd96] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:55:33.700409 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-3f6b9e51-bf42-4adb-8446-6ab3ae2907d4 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:55:33.700872 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-3f6b9e51-bf42-4adb-8446-6ab3ae2907d4 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:55:33.701644 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-3f6b9e51-bf42-4adb-8446-6ab3ae2907d4 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:55:33.702118 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-3f6b9e51-bf42-4adb-8446-6ab3ae2907d4 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:55:33.832134 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-3f6b9e51-bf42-4adb-8446-6ab3ae2907d4 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90033e5e8e634b699bf050e36519f8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8112a5759c444c1f94be24ab61bf072f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:55:33.839341 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-3f6b9e51-bf42-4adb-8446-6ab3ae2907d4 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] 10.222.0.26 "GET /compute/v2.1/servers/c24fee69-5bf4-40f4-ba18-56aecd12dd96" status: 200 len: 1520 microversion: 2.1 time: 0.150525 Mar 05 02:55:33.839935 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 225/463] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:55:33 2022] GET /compute/v2.1/servers/c24fee69-5bf4-40f4-ba18-56aecd12dd96 => generated 1520 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 02:55:34.276694 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-b44eb772-3573-46c0-aad9-98e8b899315a tempest-VolumesSnapshotTestJSON-729970751 tempest-VolumesSnapshotTestJSON-729970751-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:55:34.277294 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-b44eb772-3573-46c0-aad9-98e8b899315a tempest-VolumesSnapshotTestJSON-729970751 tempest-VolumesSnapshotTestJSON-729970751-project] [instance: b89e62f7-7ccc-48a6-ad76-88f6e022fe95] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:55:34.283843 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-b44eb772-3573-46c0-aad9-98e8b899315a tempest-VolumesSnapshotTestJSON-729970751 tempest-VolumesSnapshotTestJSON-729970751-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:55:34.284288 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-b44eb772-3573-46c0-aad9-98e8b899315a tempest-VolumesSnapshotTestJSON-729970751 tempest-VolumesSnapshotTestJSON-729970751-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:55:34.285132 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-b44eb772-3573-46c0-aad9-98e8b899315a tempest-VolumesSnapshotTestJSON-729970751 tempest-VolumesSnapshotTestJSON-729970751-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:55:34.285600 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-b44eb772-3573-46c0-aad9-98e8b899315a tempest-VolumesSnapshotTestJSON-729970751 tempest-VolumesSnapshotTestJSON-729970751-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:55:34.417296 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-b44eb772-3573-46c0-aad9-98e8b899315a tempest-VolumesSnapshotTestJSON-729970751 tempest-VolumesSnapshotTestJSON-729970751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84de0440c1444309d9c9b6c706bae73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8efa5f5dbc9f460aa91f4f62eb57abee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:55:34.425339 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-b44eb772-3573-46c0-aad9-98e8b899315a tempest-VolumesSnapshotTestJSON-729970751 tempest-VolumesSnapshotTestJSON-729970751-project] 10.222.0.26 "GET /compute/v2.1/servers/b89e62f7-7ccc-48a6-ad76-88f6e022fe95" status: 200 len: 1512 microversion: 2.1 time: 0.152507 Mar 05 02:55:34.425906 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 239/464] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:55:34 2022] GET /compute/v2.1/servers/b89e62f7-7ccc-48a6-ad76-88f6e022fe95 => generated 1512 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 02:55:34.856937 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-cddf30a1-b55a-4929-9097-3f4fba337b4a tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:55:34.857583 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-cddf30a1-b55a-4929-9097-3f4fba337b4a tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] [instance: c24fee69-5bf4-40f4-ba18-56aecd12dd96] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:55:34.863850 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-cddf30a1-b55a-4929-9097-3f4fba337b4a tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:55:34.864301 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-cddf30a1-b55a-4929-9097-3f4fba337b4a tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:55:34.865076 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-cddf30a1-b55a-4929-9097-3f4fba337b4a tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:55:34.865518 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-cddf30a1-b55a-4929-9097-3f4fba337b4a tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:55:34.994940 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-cddf30a1-b55a-4929-9097-3f4fba337b4a tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90033e5e8e634b699bf050e36519f8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8112a5759c444c1f94be24ab61bf072f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:55:35.002306 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-cddf30a1-b55a-4929-9097-3f4fba337b4a tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] 10.222.0.26 "GET /compute/v2.1/servers/c24fee69-5bf4-40f4-ba18-56aecd12dd96" status: 200 len: 1520 microversion: 2.1 time: 0.150068 Mar 05 02:55:35.002879 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 226/465] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:55:34 2022] GET /compute/v2.1/servers/c24fee69-5bf4-40f4-ba18-56aecd12dd96 => generated 1520 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 02:55:35.443194 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-62831c5f-74be-4b7a-927e-0b743ab5fb08 tempest-VolumesSnapshotTestJSON-729970751 tempest-VolumesSnapshotTestJSON-729970751-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:55:35.443780 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-62831c5f-74be-4b7a-927e-0b743ab5fb08 tempest-VolumesSnapshotTestJSON-729970751 tempest-VolumesSnapshotTestJSON-729970751-project] [instance: b89e62f7-7ccc-48a6-ad76-88f6e022fe95] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:55:35.450469 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-62831c5f-74be-4b7a-927e-0b743ab5fb08 tempest-VolumesSnapshotTestJSON-729970751 tempest-VolumesSnapshotTestJSON-729970751-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:55:35.450912 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-62831c5f-74be-4b7a-927e-0b743ab5fb08 tempest-VolumesSnapshotTestJSON-729970751 tempest-VolumesSnapshotTestJSON-729970751-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:55:35.451671 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-62831c5f-74be-4b7a-927e-0b743ab5fb08 tempest-VolumesSnapshotTestJSON-729970751 tempest-VolumesSnapshotTestJSON-729970751-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:55:35.452101 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-62831c5f-74be-4b7a-927e-0b743ab5fb08 tempest-VolumesSnapshotTestJSON-729970751 tempest-VolumesSnapshotTestJSON-729970751-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:55:35.578822 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-62831c5f-74be-4b7a-927e-0b743ab5fb08 tempest-VolumesSnapshotTestJSON-729970751 tempest-VolumesSnapshotTestJSON-729970751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84de0440c1444309d9c9b6c706bae73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8efa5f5dbc9f460aa91f4f62eb57abee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:55:35.586169 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-62831c5f-74be-4b7a-927e-0b743ab5fb08 tempest-VolumesSnapshotTestJSON-729970751 tempest-VolumesSnapshotTestJSON-729970751-project] 10.222.0.26 "GET /compute/v2.1/servers/b89e62f7-7ccc-48a6-ad76-88f6e022fe95" status: 200 len: 1512 microversion: 2.1 time: 0.146788 Mar 05 02:55:35.586739 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 240/466] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:55:35 2022] GET /compute/v2.1/servers/b89e62f7-7ccc-48a6-ad76-88f6e022fe95 => generated 1512 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 02:55:36.019610 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-148e36c1-ab34-457d-ad73-fd83c1b26c01 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:55:36.020534 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-148e36c1-ab34-457d-ad73-fd83c1b26c01 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] [instance: c24fee69-5bf4-40f4-ba18-56aecd12dd96] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:55:36.027256 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-148e36c1-ab34-457d-ad73-fd83c1b26c01 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:55:36.027893 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-148e36c1-ab34-457d-ad73-fd83c1b26c01 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:55:36.029192 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-148e36c1-ab34-457d-ad73-fd83c1b26c01 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:55:36.029767 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-148e36c1-ab34-457d-ad73-fd83c1b26c01 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:55:36.037114 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [req-4d12e3d4-ff03-4702-a70d-d5f6006b8b8f req-692f484e-b14d-448e-8d33-f2d7789902e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b89e62f7-7ccc-48a6-ad76-88f6e022fe95", "name": "network-vif-deleted", "tag": "1165b4f9-8e23-488c-bf07-4804d1f8bb98"}]} {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 02:55:36.045324 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [req-4d12e3d4-ff03-4702-a70d-d5f6006b8b8f req-692f484e-b14d-448e-8d33-f2d7789902e2 service nova] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:55:36.045767 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [req-4d12e3d4-ff03-4702-a70d-d5f6006b8b8f req-692f484e-b14d-448e-8d33-f2d7789902e2 service nova] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:55:36.056517 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.compute.server_external_events [req-4d12e3d4-ff03-4702-a70d-d5f6006b8b8f req-692f484e-b14d-448e-8d33-f2d7789902e2 service nova] Creating event network-vif-deleted:1165b4f9-8e23-488c-bf07-4804d1f8bb98 for instance b89e62f7-7ccc-48a6-ad76-88f6e022fe95 on hv-cinder-82725 Mar 05 02:55:36.062203 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [req-4d12e3d4-ff03-4702-a70d-d5f6006b8b8f req-692f484e-b14d-448e-8d33-f2d7789902e2 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029337 Mar 05 02:55:36.062761 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 241/467] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Mar 5 02:55:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 05 02:55:36.176814 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-148e36c1-ab34-457d-ad73-fd83c1b26c01 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90033e5e8e634b699bf050e36519f8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8112a5759c444c1f94be24ab61bf072f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:55:36.184246 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-148e36c1-ab34-457d-ad73-fd83c1b26c01 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] 10.222.0.26 "GET /compute/v2.1/servers/c24fee69-5bf4-40f4-ba18-56aecd12dd96" status: 200 len: 1520 microversion: 2.1 time: 0.168432 Mar 05 02:55:36.184820 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 227/468] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:55:36 2022] GET /compute/v2.1/servers/c24fee69-5bf4-40f4-ba18-56aecd12dd96 => generated 1520 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 02:55:36.605304 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-eead54fe-fac6-4cde-bcd1-2f8b2240261d tempest-VolumesSnapshotTestJSON-729970751 tempest-VolumesSnapshotTestJSON-729970751-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:55:36.606096 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-eead54fe-fac6-4cde-bcd1-2f8b2240261d tempest-VolumesSnapshotTestJSON-729970751 tempest-VolumesSnapshotTestJSON-729970751-project] [instance: b89e62f7-7ccc-48a6-ad76-88f6e022fe95] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:55:36.612094 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-eead54fe-fac6-4cde-bcd1-2f8b2240261d tempest-VolumesSnapshotTestJSON-729970751 tempest-VolumesSnapshotTestJSON-729970751-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:55:36.612544 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-eead54fe-fac6-4cde-bcd1-2f8b2240261d tempest-VolumesSnapshotTestJSON-729970751 tempest-VolumesSnapshotTestJSON-729970751-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:55:36.613311 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-eead54fe-fac6-4cde-bcd1-2f8b2240261d tempest-VolumesSnapshotTestJSON-729970751 tempest-VolumesSnapshotTestJSON-729970751-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:55:36.613752 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-eead54fe-fac6-4cde-bcd1-2f8b2240261d tempest-VolumesSnapshotTestJSON-729970751 tempest-VolumesSnapshotTestJSON-729970751-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:55:36.628772 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.wsgi [None req-eead54fe-fac6-4cde-bcd1-2f8b2240261d tempest-VolumesSnapshotTestJSON-729970751 tempest-VolumesSnapshotTestJSON-729970751-project] HTTP exception thrown: Instance b89e62f7-7ccc-48a6-ad76-88f6e022fe95 could not be found. Mar 05 02:55:36.629364 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-eead54fe-fac6-4cde-bcd1-2f8b2240261d tempest-VolumesSnapshotTestJSON-729970751 tempest-VolumesSnapshotTestJSON-729970751-project] Returning 404 to user: Instance b89e62f7-7ccc-48a6-ad76-88f6e022fe95 could not be found. {{(pid=123545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 02:55:36.630213 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-eead54fe-fac6-4cde-bcd1-2f8b2240261d tempest-VolumesSnapshotTestJSON-729970751 tempest-VolumesSnapshotTestJSON-729970751-project] 10.222.0.26 "GET /compute/v2.1/servers/b89e62f7-7ccc-48a6-ad76-88f6e022fe95" status: 404 len: 111 microversion: 2.1 time: 0.029887 Mar 05 02:55:36.630758 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 242/469] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:55:36 2022] GET /compute/v2.1/servers/b89e62f7-7ccc-48a6-ad76-88f6e022fe95 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 05 02:55:37.200837 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-bdb51ef0-8fee-4341-8130-6ecd7b451d09 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:55:37.201477 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-bdb51ef0-8fee-4341-8130-6ecd7b451d09 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] [instance: c24fee69-5bf4-40f4-ba18-56aecd12dd96] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:55:37.207765 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-bdb51ef0-8fee-4341-8130-6ecd7b451d09 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:55:37.208215 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-bdb51ef0-8fee-4341-8130-6ecd7b451d09 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:55:37.208979 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-bdb51ef0-8fee-4341-8130-6ecd7b451d09 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:55:37.209526 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-bdb51ef0-8fee-4341-8130-6ecd7b451d09 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:55:37.342050 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-bdb51ef0-8fee-4341-8130-6ecd7b451d09 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90033e5e8e634b699bf050e36519f8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8112a5759c444c1f94be24ab61bf072f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:55:37.349203 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-bdb51ef0-8fee-4341-8130-6ecd7b451d09 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] 10.222.0.26 "GET /compute/v2.1/servers/c24fee69-5bf4-40f4-ba18-56aecd12dd96" status: 200 len: 1520 microversion: 2.1 time: 0.152440 Mar 05 02:55:37.349764 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 228/470] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:55:37 2022] GET /compute/v2.1/servers/c24fee69-5bf4-40f4-ba18-56aecd12dd96 => generated 1520 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 02:55:38.367198 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-77371f03-034c-47cc-9467-ff1e4547ee78 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:55:38.367803 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-77371f03-034c-47cc-9467-ff1e4547ee78 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] [instance: c24fee69-5bf4-40f4-ba18-56aecd12dd96] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:55:38.374708 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-77371f03-034c-47cc-9467-ff1e4547ee78 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:55:38.375162 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-77371f03-034c-47cc-9467-ff1e4547ee78 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:55:38.375928 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-77371f03-034c-47cc-9467-ff1e4547ee78 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:55:38.376362 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-77371f03-034c-47cc-9467-ff1e4547ee78 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:55:38.504255 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-77371f03-034c-47cc-9467-ff1e4547ee78 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90033e5e8e634b699bf050e36519f8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8112a5759c444c1f94be24ab61bf072f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:55:38.511482 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-77371f03-034c-47cc-9467-ff1e4547ee78 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] 10.222.0.26 "GET /compute/v2.1/servers/c24fee69-5bf4-40f4-ba18-56aecd12dd96" status: 200 len: 1520 microversion: 2.1 time: 0.148195 Mar 05 02:55:38.512104 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 243/471] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:55:38 2022] GET /compute/v2.1/servers/c24fee69-5bf4-40f4-ba18-56aecd12dd96 => generated 1520 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 02:55:39.528205 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-22844d7a-ee34-42eb-bdfd-a20f7b8269fd tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:55:39.528830 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-22844d7a-ee34-42eb-bdfd-a20f7b8269fd tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] [instance: c24fee69-5bf4-40f4-ba18-56aecd12dd96] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:55:39.535078 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-22844d7a-ee34-42eb-bdfd-a20f7b8269fd tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:55:39.535530 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-22844d7a-ee34-42eb-bdfd-a20f7b8269fd tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:55:39.536311 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-22844d7a-ee34-42eb-bdfd-a20f7b8269fd tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:55:39.536743 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-22844d7a-ee34-42eb-bdfd-a20f7b8269fd tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:55:39.669391 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-22844d7a-ee34-42eb-bdfd-a20f7b8269fd tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90033e5e8e634b699bf050e36519f8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8112a5759c444c1f94be24ab61bf072f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:55:39.676705 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-22844d7a-ee34-42eb-bdfd-a20f7b8269fd tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] 10.222.0.26 "GET /compute/v2.1/servers/c24fee69-5bf4-40f4-ba18-56aecd12dd96" status: 200 len: 1520 microversion: 2.1 time: 0.152379 Mar 05 02:55:39.677279 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 229/472] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:55:39 2022] GET /compute/v2.1/servers/c24fee69-5bf4-40f4-ba18-56aecd12dd96 => generated 1520 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 02:55:39.832835 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 05 02:55:39.833326 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: Sat Mar 5 02:55:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 05 02:55:40.693417 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-f21f59a6-d8f6-4cef-a855-b80165d609d7 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:55:40.694280 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-f21f59a6-d8f6-4cef-a855-b80165d609d7 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] [instance: c24fee69-5bf4-40f4-ba18-56aecd12dd96] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:55:40.701255 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-f21f59a6-d8f6-4cef-a855-b80165d609d7 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:55:40.701695 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-f21f59a6-d8f6-4cef-a855-b80165d609d7 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:55:40.702506 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-f21f59a6-d8f6-4cef-a855-b80165d609d7 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:55:40.703163 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-f21f59a6-d8f6-4cef-a855-b80165d609d7 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:55:40.704575 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [req-c22e6011-aebb-4575-96d9-da421e95e44f req-2a6f8846-0573-42b3-9c09-65afd3fe6ca7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c24fee69-5bf4-40f4-ba18-56aecd12dd96", "name": "network-vif-deleted", "tag": "97ec8c13-e022-49e6-a358-8a738e1e166c"}]} {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 02:55:40.712423 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [req-c22e6011-aebb-4575-96d9-da421e95e44f req-2a6f8846-0573-42b3-9c09-65afd3fe6ca7 service nova] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:55:40.712861 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [req-c22e6011-aebb-4575-96d9-da421e95e44f req-2a6f8846-0573-42b3-9c09-65afd3fe6ca7 service nova] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:55:40.724403 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.compute.server_external_events [req-c22e6011-aebb-4575-96d9-da421e95e44f req-2a6f8846-0573-42b3-9c09-65afd3fe6ca7 service nova] Creating event network-vif-deleted:97ec8c13-e022-49e6-a358-8a738e1e166c for instance c24fee69-5bf4-40f4-ba18-56aecd12dd96 on hv-cinder-82725 Mar 05 02:55:40.729685 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [req-c22e6011-aebb-4575-96d9-da421e95e44f req-2a6f8846-0573-42b3-9c09-65afd3fe6ca7 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029049 Mar 05 02:55:40.731918 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 230/473] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Mar 5 02:55:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 02:55:40.765065 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-f21f59a6-d8f6-4cef-a855-b80165d609d7 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90033e5e8e634b699bf050e36519f8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8112a5759c444c1f94be24ab61bf072f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:55:40.772593 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-f21f59a6-d8f6-4cef-a855-b80165d609d7 tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] 10.222.0.26 "GET /compute/v2.1/servers/c24fee69-5bf4-40f4-ba18-56aecd12dd96" status: 200 len: 1478 microversion: 2.1 time: 0.083076 Mar 05 02:55:40.773250 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 244/474] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:55:40 2022] GET /compute/v2.1/servers/c24fee69-5bf4-40f4-ba18-56aecd12dd96 => generated 1478 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 02:55:41.789756 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-3c9105d9-0260-484e-a684-9d9069d0c85c tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:55:41.790477 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-3c9105d9-0260-484e-a684-9d9069d0c85c tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] [instance: c24fee69-5bf4-40f4-ba18-56aecd12dd96] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:55:41.797350 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-3c9105d9-0260-484e-a684-9d9069d0c85c tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:55:41.797799 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-3c9105d9-0260-484e-a684-9d9069d0c85c tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:55:41.798609 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-3c9105d9-0260-484e-a684-9d9069d0c85c tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:55:41.799048 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-3c9105d9-0260-484e-a684-9d9069d0c85c tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:55:41.814361 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.wsgi [None req-3c9105d9-0260-484e-a684-9d9069d0c85c tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] HTTP exception thrown: Instance c24fee69-5bf4-40f4-ba18-56aecd12dd96 could not be found. Mar 05 02:55:41.814942 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-3c9105d9-0260-484e-a684-9d9069d0c85c tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] Returning 404 to user: Instance c24fee69-5bf4-40f4-ba18-56aecd12dd96 could not be found. {{(pid=123546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 02:55:41.815754 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-3c9105d9-0260-484e-a684-9d9069d0c85c tempest-ServerRescueNegativeTestJSON-147377845 tempest-ServerRescueNegativeTestJSON-147377845-project] 10.222.0.26 "GET /compute/v2.1/servers/c24fee69-5bf4-40f4-ba18-56aecd12dd96" status: 404 len: 111 microversion: 2.1 time: 0.030943 Mar 05 02:55:41.816285 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 231/475] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:55:41 2022] GET /compute/v2.1/servers/c24fee69-5bf4-40f4-ba18-56aecd12dd96 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 05 02:55:45.447995 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-683df1ef-1b71-446b-935f-13f2aeee1820 tempest-VolumesSnapshotTestJSON-729970751 tempest-VolumesSnapshotTestJSON-729970751-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1041546842", "imageRef": "adbc7df1-116e-4f9f-a28d-a6a3c084cceb", "flavorRef": "452", "networks": [{"uuid": "68be04e0-e340-4669-98a5-143d697647c0"}]}} {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 02:55:45.500846 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.network.neutron [None req-683df1ef-1b71-446b-935f-13f2aeee1820 tempest-VolumesSnapshotTestJSON-729970751 tempest-VolumesSnapshotTestJSON-729970751-project] validate_networks() for [('68be04e0-e340-4669-98a5-143d697647c0', None, None, None, None, None)] {{(pid=123545) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 05 02:55:45.841807 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.virt.hardware [None req-683df1ef-1b71-446b-935f-13f2aeee1820 tempest-VolumesSnapshotTestJSON-729970751 tempest-VolumesSnapshotTestJSON-729970751-project] Flavor limits 0:0:0 {{(pid=123545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 05 02:55:45.842323 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.virt.hardware [None req-683df1ef-1b71-446b-935f-13f2aeee1820 tempest-VolumesSnapshotTestJSON-729970751 tempest-VolumesSnapshotTestJSON-729970751-project] Image limits 0:0:0 {{(pid=123545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 05 02:55:45.842745 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.virt.hardware [None req-683df1ef-1b71-446b-935f-13f2aeee1820 tempest-VolumesSnapshotTestJSON-729970751 tempest-VolumesSnapshotTestJSON-729970751-project] Flavor pref 0:0:0 {{(pid=123545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 05 02:55:45.843156 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.virt.hardware [None req-683df1ef-1b71-446b-935f-13f2aeee1820 tempest-VolumesSnapshotTestJSON-729970751 tempest-VolumesSnapshotTestJSON-729970751-project] Image pref 0:0:0 {{(pid=123545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 05 02:55:45.843574 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.virt.hardware [None req-683df1ef-1b71-446b-935f-13f2aeee1820 tempest-VolumesSnapshotTestJSON-729970751 tempest-VolumesSnapshotTestJSON-729970751-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 05 02:55:45.852103 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-683df1ef-1b71-446b-935f-13f2aeee1820 tempest-VolumesSnapshotTestJSON-729970751 tempest-VolumesSnapshotTestJSON-729970751-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:55:45.852561 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-683df1ef-1b71-446b-935f-13f2aeee1820 tempest-VolumesSnapshotTestJSON-729970751 tempest-VolumesSnapshotTestJSON-729970751-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:55:45.853365 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-683df1ef-1b71-446b-935f-13f2aeee1820 tempest-VolumesSnapshotTestJSON-729970751 tempest-VolumesSnapshotTestJSON-729970751-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:55:45.854087 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-683df1ef-1b71-446b-935f-13f2aeee1820 tempest-VolumesSnapshotTestJSON-729970751 tempest-VolumesSnapshotTestJSON-729970751-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:55:45.871420 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.quota [None req-683df1ef-1b71-446b-935f-13f2aeee1820 tempest-VolumesSnapshotTestJSON-729970751 tempest-VolumesSnapshotTestJSON-729970751-project] Getting quotas for project 8efa5f5dbc9f460aa91f4f62eb57abee. Resources: {'ram', 'cores', 'instances'} {{(pid=123545) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 02:55:45.875946 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.quota [None req-683df1ef-1b71-446b-935f-13f2aeee1820 tempest-VolumesSnapshotTestJSON-729970751 tempest-VolumesSnapshotTestJSON-729970751-project] Getting quotas for user f84de0440c1444309d9c9b6c706bae73 and project 8efa5f5dbc9f460aa91f4f62eb57abee. Resources: {'ram', 'cores', 'instances'} {{(pid=123545) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 02:55:45.886543 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-683df1ef-1b71-446b-935f-13f2aeee1820 tempest-VolumesSnapshotTestJSON-729970751 tempest-VolumesSnapshotTestJSON-729970751-project] Going to run 1 instances... {{(pid=123545) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 05 02:55:45.889161 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-683df1ef-1b71-446b-935f-13f2aeee1820 tempest-VolumesSnapshotTestJSON-729970751 tempest-VolumesSnapshotTestJSON-729970751-project] [instance: 110e5aaf-5b65-47ec-8a04-b48155049cf5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='adbc7df1-116e-4f9f-a28d-a6a3c084cceb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123545) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 05 02:55:45.936188 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-683df1ef-1b71-446b-935f-13f2aeee1820 tempest-VolumesSnapshotTestJSON-729970751 tempest-VolumesSnapshotTestJSON-729970751-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.491813 Mar 05 02:55:45.936991 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 245/476] 10.222.0.26 () {60 vars in 1146 bytes} [Sat Mar 5 02:55:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 493 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 05 02:55:45.946816 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-628ac883-f190-48a7-83dc-d032a20ef207 tempest-VolumesSnapshotTestJSON-729970751 tempest-VolumesSnapshotTestJSON-729970751-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:55:45.947423 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-628ac883-f190-48a7-83dc-d032a20ef207 tempest-VolumesSnapshotTestJSON-729970751 tempest-VolumesSnapshotTestJSON-729970751-project] [instance: 110e5aaf-5b65-47ec-8a04-b48155049cf5] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:55:46.004777 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-628ac883-f190-48a7-83dc-d032a20ef207 tempest-VolumesSnapshotTestJSON-729970751 tempest-VolumesSnapshotTestJSON-729970751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84de0440c1444309d9c9b6c706bae73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8efa5f5dbc9f460aa91f4f62eb57abee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:55:46.014564 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-628ac883-f190-48a7-83dc-d032a20ef207 tempest-VolumesSnapshotTestJSON-729970751 tempest-VolumesSnapshotTestJSON-729970751-project] 10.222.0.26 "GET /compute/v2.1/servers/110e5aaf-5b65-47ec-8a04-b48155049cf5" status: 200 len: 1219 microversion: 2.1 time: 0.071520 Mar 05 02:55:46.023802 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 232/477] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:55:45 2022] GET /compute/v2.1/servers/110e5aaf-5b65-47ec-8a04-b48155049cf5 => generated 1219 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 02:55:47.036645 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-6937c1d6-8b33-4b71-bf58-0975957b108a tempest-VolumesSnapshotTestJSON-729970751 tempest-VolumesSnapshotTestJSON-729970751-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:55:47.037246 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-6937c1d6-8b33-4b71-bf58-0975957b108a tempest-VolumesSnapshotTestJSON-729970751 tempest-VolumesSnapshotTestJSON-729970751-project] [instance: 110e5aaf-5b65-47ec-8a04-b48155049cf5] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:55:47.058152 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-6937c1d6-8b33-4b71-bf58-0975957b108a tempest-VolumesSnapshotTestJSON-729970751 tempest-VolumesSnapshotTestJSON-729970751-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:55:47.058641 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-6937c1d6-8b33-4b71-bf58-0975957b108a tempest-VolumesSnapshotTestJSON-729970751 tempest-VolumesSnapshotTestJSON-729970751-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:55:47.062522 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-6937c1d6-8b33-4b71-bf58-0975957b108a tempest-VolumesSnapshotTestJSON-729970751 tempest-VolumesSnapshotTestJSON-729970751-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:55:47.063055 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-6937c1d6-8b33-4b71-bf58-0975957b108a tempest-VolumesSnapshotTestJSON-729970751 tempest-VolumesSnapshotTestJSON-729970751-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:55:47.185899 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-6937c1d6-8b33-4b71-bf58-0975957b108a tempest-VolumesSnapshotTestJSON-729970751 tempest-VolumesSnapshotTestJSON-729970751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84de0440c1444309d9c9b6c706bae73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8efa5f5dbc9f460aa91f4f62eb57abee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:55:47.215497 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-6937c1d6-8b33-4b71-bf58-0975957b108a tempest-VolumesSnapshotTestJSON-729970751 tempest-VolumesSnapshotTestJSON-729970751-project] 10.222.0.26 "GET /compute/v2.1/servers/110e5aaf-5b65-47ec-8a04-b48155049cf5" status: 200 len: 1289 microversion: 2.1 time: 0.187355 Mar 05 02:55:47.218911 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 246/478] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:55:47 2022] GET /compute/v2.1/servers/110e5aaf-5b65-47ec-8a04-b48155049cf5 => generated 1289 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 02:55:48.124974 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-f4b0ef6a-f160-463c-9da1-912b4d210ecc tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:55:48.126119 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-f4b0ef6a-f160-463c-9da1-912b4d210ecc tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] [instance: d0080e4b-6532-4e0c-8d19-cfbdf32e401b] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:55:48.133753 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-f4b0ef6a-f160-463c-9da1-912b4d210ecc tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:55:48.134523 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-f4b0ef6a-f160-463c-9da1-912b4d210ecc tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:55:48.135478 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-f4b0ef6a-f160-463c-9da1-912b4d210ecc tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:55:48.136078 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-f4b0ef6a-f160-463c-9da1-912b4d210ecc tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:55:48.227088 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.objects.instance [None req-f4b0ef6a-f160-463c-9da1-912b4d210ecc tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lazy-loading 'services' on Instance uuid d0080e4b-6532-4e0c-8d19-cfbdf32e401b {{(pid=123546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 05 02:55:48.233611 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-5f765b74-1946-4c95-826f-7f7de927c670 tempest-VolumesSnapshotTestJSON-729970751 tempest-VolumesSnapshotTestJSON-729970751-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:55:48.234243 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-5f765b74-1946-4c95-826f-7f7de927c670 tempest-VolumesSnapshotTestJSON-729970751 tempest-VolumesSnapshotTestJSON-729970751-project] [instance: 110e5aaf-5b65-47ec-8a04-b48155049cf5] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:55:48.241103 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-5f765b74-1946-4c95-826f-7f7de927c670 tempest-VolumesSnapshotTestJSON-729970751 tempest-VolumesSnapshotTestJSON-729970751-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:55:48.247823 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-5f765b74-1946-4c95-826f-7f7de927c670 tempest-VolumesSnapshotTestJSON-729970751 tempest-VolumesSnapshotTestJSON-729970751-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:55:48.249042 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-5f765b74-1946-4c95-826f-7f7de927c670 tempest-VolumesSnapshotTestJSON-729970751 tempest-VolumesSnapshotTestJSON-729970751-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:55:48.250525 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-5f765b74-1946-4c95-826f-7f7de927c670 tempest-VolumesSnapshotTestJSON-729970751 tempest-VolumesSnapshotTestJSON-729970751-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:55:48.314681 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-f4b0ef6a-f160-463c-9da1-912b4d210ecc tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] 10.222.0.26 "DELETE /compute/v2.1/servers/d0080e4b-6532-4e0c-8d19-cfbdf32e401b/os-volume_attachments/0ec89b5f-bb9d-481f-a640-699f48b2c64c" status: 202 len: 0 microversion: 2.1 time: 0.193374 Mar 05 02:55:48.315879 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 233/479] 10.222.0.26 () {58 vars in 1415 bytes} [Sat Mar 5 02:55:48 2022] DELETE /compute/v2.1/servers/d0080e4b-6532-4e0c-8d19-cfbdf32e401b/os-volume_attachments/0ec89b5f-bb9d-481f-a640-699f48b2c64c => generated 0 bytes in 196 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 05 02:55:48.545706 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-5f765b74-1946-4c95-826f-7f7de927c670 tempest-VolumesSnapshotTestJSON-729970751 tempest-VolumesSnapshotTestJSON-729970751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84de0440c1444309d9c9b6c706bae73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8efa5f5dbc9f460aa91f4f62eb57abee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:55:48.553542 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-5f765b74-1946-4c95-826f-7f7de927c670 tempest-VolumesSnapshotTestJSON-729970751 tempest-VolumesSnapshotTestJSON-729970751-project] 10.222.0.26 "GET /compute/v2.1/servers/110e5aaf-5b65-47ec-8a04-b48155049cf5" status: 200 len: 1319 microversion: 2.1 time: 0.324592 Mar 05 02:55:48.554561 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 247/480] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:55:48 2022] GET /compute/v2.1/servers/110e5aaf-5b65-47ec-8a04-b48155049cf5 => generated 1319 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 02:55:48.869765 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [req-7bfe1e4d-9496-47b3-8232-2a1f501a7bfe req-9e0a4ae0-22a1-47a6-9ed8-70f9dffa672a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "110e5aaf-5b65-47ec-8a04-b48155049cf5", "tag": "7d66b0a8-f21d-42f8-a151-dddba94a3dfe"}]} {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 02:55:48.891899 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [req-7bfe1e4d-9496-47b3-8232-2a1f501a7bfe req-9e0a4ae0-22a1-47a6-9ed8-70f9dffa672a service nova] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:55:48.892592 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [req-7bfe1e4d-9496-47b3-8232-2a1f501a7bfe req-9e0a4ae0-22a1-47a6-9ed8-70f9dffa672a service nova] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:55:48.914980 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.compute.server_external_events [req-7bfe1e4d-9496-47b3-8232-2a1f501a7bfe req-9e0a4ae0-22a1-47a6-9ed8-70f9dffa672a service nova] Creating event network-changed:7d66b0a8-f21d-42f8-a151-dddba94a3dfe for instance 110e5aaf-5b65-47ec-8a04-b48155049cf5 on hv-cinder-82725 Mar 05 02:55:48.928046 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [req-7bfe1e4d-9496-47b3-8232-2a1f501a7bfe req-9e0a4ae0-22a1-47a6-9ed8-70f9dffa672a service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062711 Mar 05 02:55:48.928986 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 234/481] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Mar 5 02:55:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 02:55:49.467844 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-5610751b-b254-49e5-b24b-ba78a4ff56cf tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 02:55:49.474178 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-5610751b-b254-49e5-b24b-ba78a4ff56cf tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:55:49.474634 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-5610751b-b254-49e5-b24b-ba78a4ff56cf tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:55:49.543348 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-5610751b-b254-49e5-b24b-ba78a4ff56cf tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] [instance: d0080e4b-6532-4e0c-8d19-cfbdf32e401b] Going to try to stop instance {{(pid=123545) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Mar 05 02:55:49.571762 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-41774816-e8cf-48ff-bf89-8d413937c944 tempest-VolumesSnapshotTestJSON-729970751 tempest-VolumesSnapshotTestJSON-729970751-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:55:49.573442 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-41774816-e8cf-48ff-bf89-8d413937c944 tempest-VolumesSnapshotTestJSON-729970751 tempest-VolumesSnapshotTestJSON-729970751-project] [instance: 110e5aaf-5b65-47ec-8a04-b48155049cf5] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:55:49.587452 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-41774816-e8cf-48ff-bf89-8d413937c944 tempest-VolumesSnapshotTestJSON-729970751 tempest-VolumesSnapshotTestJSON-729970751-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:55:49.587969 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-41774816-e8cf-48ff-bf89-8d413937c944 tempest-VolumesSnapshotTestJSON-729970751 tempest-VolumesSnapshotTestJSON-729970751-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:55:49.592026 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-41774816-e8cf-48ff-bf89-8d413937c944 tempest-VolumesSnapshotTestJSON-729970751 tempest-VolumesSnapshotTestJSON-729970751-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:55:49.592628 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-41774816-e8cf-48ff-bf89-8d413937c944 tempest-VolumesSnapshotTestJSON-729970751 tempest-VolumesSnapshotTestJSON-729970751-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:55:49.598697 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-5610751b-b254-49e5-b24b-ba78a4ff56cf tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] 10.222.0.26 "POST /compute/v2.1/servers/d0080e4b-6532-4e0c-8d19-cfbdf32e401b/action" status: 202 len: 0 microversion: 2.1 time: 0.134838 Mar 05 02:55:49.600232 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 248/482] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Mar 5 02:55:49 2022] POST /compute/v2.1/servers/d0080e4b-6532-4e0c-8d19-cfbdf32e401b/action => generated 0 bytes in 138 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 05 02:55:49.615342 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-4fb8330f-c2b9-4c76-9492-c07d01a87ff2 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:55:49.624722 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-4fb8330f-c2b9-4c76-9492-c07d01a87ff2 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] [instance: d0080e4b-6532-4e0c-8d19-cfbdf32e401b] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:55:49.639201 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-4fb8330f-c2b9-4c76-9492-c07d01a87ff2 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:55:49.639849 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-4fb8330f-c2b9-4c76-9492-c07d01a87ff2 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:55:49.640779 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-4fb8330f-c2b9-4c76-9492-c07d01a87ff2 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:55:49.643372 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-4fb8330f-c2b9-4c76-9492-c07d01a87ff2 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:55:50.058997 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-4fb8330f-c2b9-4c76-9492-c07d01a87ff2 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e5a000087fe40419ccd0d1a96fb4783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9d27da2e71d4962a53a95efc46518ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:55:50.072680 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-4fb8330f-c2b9-4c76-9492-c07d01a87ff2 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] 10.222.0.26 "GET /compute/v2.1/servers/d0080e4b-6532-4e0c-8d19-cfbdf32e401b" status: 200 len: 1678 microversion: 2.1 time: 0.465537 Mar 05 02:55:50.074292 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 249/483] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:55:49 2022] GET /compute/v2.1/servers/d0080e4b-6532-4e0c-8d19-cfbdf32e401b => generated 1678 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 02:55:50.092109 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-41774816-e8cf-48ff-bf89-8d413937c944 tempest-VolumesSnapshotTestJSON-729970751 tempest-VolumesSnapshotTestJSON-729970751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84de0440c1444309d9c9b6c706bae73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8efa5f5dbc9f460aa91f4f62eb57abee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:55:50.100468 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-41774816-e8cf-48ff-bf89-8d413937c944 tempest-VolumesSnapshotTestJSON-729970751 tempest-VolumesSnapshotTestJSON-729970751-project] 10.222.0.26 "GET /compute/v2.1/servers/110e5aaf-5b65-47ec-8a04-b48155049cf5" status: 200 len: 1319 microversion: 2.1 time: 0.532963 Mar 05 02:55:50.101434 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 235/484] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:55:49 2022] GET /compute/v2.1/servers/110e5aaf-5b65-47ec-8a04-b48155049cf5 => generated 1319 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 02:55:50.734392 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-e95a839d-3dcb-4270-9e63-4db84984451a tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Action: 'create', calling method: .version_select at 0x7f3f61fac3a0>, body: {"keypair": {"name": "tempest-keypair-1187777143"}} {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 02:55:50.748139 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.quota [None req-e95a839d-3dcb-4270-9e63-4db84984451a tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Getting quotas for project 3dd2b27540c04b4c8741ce8c9a5e2b47. Resources: {'key_pairs'} {{(pid=123545) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 02:55:50.752318 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.quota [None req-e95a839d-3dcb-4270-9e63-4db84984451a tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Getting quotas for user af8fb7f45f4d4eb180ccaca3d52ed2dc and project 3dd2b27540c04b4c8741ce8c9a5e2b47. Resources: {'key_pairs'} {{(pid=123545) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 02:55:50.846147 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.quota [None req-e95a839d-3dcb-4270-9e63-4db84984451a tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Getting quotas for project 3dd2b27540c04b4c8741ce8c9a5e2b47. Resources: {'key_pairs'} {{(pid=123545) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 02:55:50.850279 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.quota [None req-e95a839d-3dcb-4270-9e63-4db84984451a tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Getting quotas for user af8fb7f45f4d4eb180ccaca3d52ed2dc and project 3dd2b27540c04b4c8741ce8c9a5e2b47. Resources: {'key_pairs'} {{(pid=123545) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 02:55:50.880311 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-e95a839d-3dcb-4270-9e63-4db84984451a tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 2305 microversion: 2.1 time: 0.287722 Mar 05 02:55:50.887094 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 250/485] 10.222.0.26 () {60 vars in 1157 bytes} [Sat Mar 5 02:55:50 2022] POST /compute/v2.1/os-keypairs => generated 2305 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 02:55:51.099056 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-b70d8992-7dbc-4fd5-b9fc-ebd6206ebc5e tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:55:51.100567 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-b70d8992-7dbc-4fd5-b9fc-ebd6206ebc5e tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] [instance: d0080e4b-6532-4e0c-8d19-cfbdf32e401b] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:55:51.108189 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-b70d8992-7dbc-4fd5-b9fc-ebd6206ebc5e tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:55:51.108648 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-b70d8992-7dbc-4fd5-b9fc-ebd6206ebc5e tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:55:51.109445 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-b70d8992-7dbc-4fd5-b9fc-ebd6206ebc5e tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:55:51.109904 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-b70d8992-7dbc-4fd5-b9fc-ebd6206ebc5e tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:55:51.119069 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-16209d80-8a18-4b52-88c9-39b3cfb1d3c7 tempest-VolumesSnapshotTestJSON-729970751 tempest-VolumesSnapshotTestJSON-729970751-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:55:51.120223 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-16209d80-8a18-4b52-88c9-39b3cfb1d3c7 tempest-VolumesSnapshotTestJSON-729970751 tempest-VolumesSnapshotTestJSON-729970751-project] [instance: 110e5aaf-5b65-47ec-8a04-b48155049cf5] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:55:51.127330 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-16209d80-8a18-4b52-88c9-39b3cfb1d3c7 tempest-VolumesSnapshotTestJSON-729970751 tempest-VolumesSnapshotTestJSON-729970751-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:55:51.128128 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-16209d80-8a18-4b52-88c9-39b3cfb1d3c7 tempest-VolumesSnapshotTestJSON-729970751 tempest-VolumesSnapshotTestJSON-729970751-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:55:51.131258 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-16209d80-8a18-4b52-88c9-39b3cfb1d3c7 tempest-VolumesSnapshotTestJSON-729970751 tempest-VolumesSnapshotTestJSON-729970751-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:55:51.131931 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-16209d80-8a18-4b52-88c9-39b3cfb1d3c7 tempest-VolumesSnapshotTestJSON-729970751 tempest-VolumesSnapshotTestJSON-729970751-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:55:51.365260 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-b70d8992-7dbc-4fd5-b9fc-ebd6206ebc5e tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e5a000087fe40419ccd0d1a96fb4783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9d27da2e71d4962a53a95efc46518ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:55:51.391213 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-b70d8992-7dbc-4fd5-b9fc-ebd6206ebc5e tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] 10.222.0.26 "GET /compute/v2.1/servers/d0080e4b-6532-4e0c-8d19-cfbdf32e401b" status: 200 len: 1678 microversion: 2.1 time: 0.295754 Mar 05 02:55:51.401664 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-16209d80-8a18-4b52-88c9-39b3cfb1d3c7 tempest-VolumesSnapshotTestJSON-729970751 tempest-VolumesSnapshotTestJSON-729970751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84de0440c1444309d9c9b6c706bae73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8efa5f5dbc9f460aa91f4f62eb57abee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:55:51.402387 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 236/486] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:55:51 2022] GET /compute/v2.1/servers/d0080e4b-6532-4e0c-8d19-cfbdf32e401b => generated 1678 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 02:55:51.410240 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-16209d80-8a18-4b52-88c9-39b3cfb1d3c7 tempest-VolumesSnapshotTestJSON-729970751 tempest-VolumesSnapshotTestJSON-729970751-project] 10.222.0.26 "GET /compute/v2.1/servers/110e5aaf-5b65-47ec-8a04-b48155049cf5" status: 200 len: 1319 microversion: 2.1 time: 0.295211 Mar 05 02:55:51.418892 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 251/487] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:55:51 2022] GET /compute/v2.1/servers/110e5aaf-5b65-47ec-8a04-b48155049cf5 => generated 1319 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 02:55:52.315389 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-e40c2d9e-18a5-4e2f-9a1f-89f06f821460 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1864344766", "imageRef": "adbc7df1-116e-4f9f-a28d-a6a3c084cceb", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ea79f853-47ea-48eb-b063-dca7ecd22a4d"}], "security_groups": [{"name": "tempest-securitygroup--211066018"}], "key_name": "tempest-keypair-1187777143", "user_data": "}} {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 02:55:52.409159 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-3955105a-484f-4d28-b6c8-e479fbc8f5b9 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:55:52.410381 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-3955105a-484f-4d28-b6c8-e479fbc8f5b9 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] [instance: d0080e4b-6532-4e0c-8d19-cfbdf32e401b] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:55:52.419745 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-3955105a-484f-4d28-b6c8-e479fbc8f5b9 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:55:52.420317 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-3955105a-484f-4d28-b6c8-e479fbc8f5b9 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:55:52.422953 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-3955105a-484f-4d28-b6c8-e479fbc8f5b9 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:55:52.423635 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-3955105a-484f-4d28-b6c8-e479fbc8f5b9 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:55:52.432068 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.network.neutron [None req-e40c2d9e-18a5-4e2f-9a1f-89f06f821460 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] validate_networks() for [('ea79f853-47ea-48eb-b063-dca7ecd22a4d', None, None, None, None, None)] {{(pid=123546) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 05 02:55:52.665862 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-3955105a-484f-4d28-b6c8-e479fbc8f5b9 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e5a000087fe40419ccd0d1a96fb4783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9d27da2e71d4962a53a95efc46518ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:55:52.673461 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-3955105a-484f-4d28-b6c8-e479fbc8f5b9 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] 10.222.0.26 "GET /compute/v2.1/servers/d0080e4b-6532-4e0c-8d19-cfbdf32e401b" status: 200 len: 1678 microversion: 2.1 time: 0.268101 Mar 05 02:55:52.682901 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 252/488] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:55:52 2022] GET /compute/v2.1/servers/d0080e4b-6532-4e0c-8d19-cfbdf32e401b => generated 1678 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 02:55:52.682901 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-1b0368e1-7c13-434b-ac97-d494e2002457 tempest-VolumesSnapshotTestJSON-729970751 tempest-VolumesSnapshotTestJSON-729970751-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:55:52.682901 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-1b0368e1-7c13-434b-ac97-d494e2002457 tempest-VolumesSnapshotTestJSON-729970751 tempest-VolumesSnapshotTestJSON-729970751-project] [instance: 110e5aaf-5b65-47ec-8a04-b48155049cf5] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:55:52.687388 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-1b0368e1-7c13-434b-ac97-d494e2002457 tempest-VolumesSnapshotTestJSON-729970751 tempest-VolumesSnapshotTestJSON-729970751-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:55:52.687846 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-1b0368e1-7c13-434b-ac97-d494e2002457 tempest-VolumesSnapshotTestJSON-729970751 tempest-VolumesSnapshotTestJSON-729970751-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:55:52.688633 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-1b0368e1-7c13-434b-ac97-d494e2002457 tempest-VolumesSnapshotTestJSON-729970751 tempest-VolumesSnapshotTestJSON-729970751-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:55:52.689072 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-1b0368e1-7c13-434b-ac97-d494e2002457 tempest-VolumesSnapshotTestJSON-729970751 tempest-VolumesSnapshotTestJSON-729970751-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:55:52.938157 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-1b0368e1-7c13-434b-ac97-d494e2002457 tempest-VolumesSnapshotTestJSON-729970751 tempest-VolumesSnapshotTestJSON-729970751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84de0440c1444309d9c9b6c706bae73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8efa5f5dbc9f460aa91f4f62eb57abee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:55:52.953375 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-1b0368e1-7c13-434b-ac97-d494e2002457 tempest-VolumesSnapshotTestJSON-729970751 tempest-VolumesSnapshotTestJSON-729970751-project] 10.222.0.26 "GET /compute/v2.1/servers/110e5aaf-5b65-47ec-8a04-b48155049cf5" status: 200 len: 1319 microversion: 2.1 time: 0.277440 Mar 05 02:55:52.955184 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.virt.hardware [None req-e40c2d9e-18a5-4e2f-9a1f-89f06f821460 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Flavor limits 0:0:0 {{(pid=123546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 05 02:55:52.955807 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.virt.hardware [None req-e40c2d9e-18a5-4e2f-9a1f-89f06f821460 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Image limits 0:0:0 {{(pid=123546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 05 02:55:52.956288 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.virt.hardware [None req-e40c2d9e-18a5-4e2f-9a1f-89f06f821460 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Flavor pref 0:0:0 {{(pid=123546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 05 02:55:52.956701 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.virt.hardware [None req-e40c2d9e-18a5-4e2f-9a1f-89f06f821460 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Image pref 0:0:0 {{(pid=123546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 05 02:55:52.957114 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.virt.hardware [None req-e40c2d9e-18a5-4e2f-9a1f-89f06f821460 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 05 02:55:52.964578 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 253/489] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:55:52 2022] GET /compute/v2.1/servers/110e5aaf-5b65-47ec-8a04-b48155049cf5 => generated 1319 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 02:55:52.966634 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-e40c2d9e-18a5-4e2f-9a1f-89f06f821460 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:55:52.967402 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-e40c2d9e-18a5-4e2f-9a1f-89f06f821460 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:55:52.968224 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-e40c2d9e-18a5-4e2f-9a1f-89f06f821460 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:55:52.968657 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-e40c2d9e-18a5-4e2f-9a1f-89f06f821460 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:55:52.987503 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.quota [None req-e40c2d9e-18a5-4e2f-9a1f-89f06f821460 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Getting quotas for project 3dd2b27540c04b4c8741ce8c9a5e2b47. Resources: {'ram', 'cores', 'instances'} {{(pid=123546) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 02:55:52.991692 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.quota [None req-e40c2d9e-18a5-4e2f-9a1f-89f06f821460 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Getting quotas for user af8fb7f45f4d4eb180ccaca3d52ed2dc and project 3dd2b27540c04b4c8741ce8c9a5e2b47. Resources: {'ram', 'cores', 'instances'} {{(pid=123546) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 02:55:53.003695 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-e40c2d9e-18a5-4e2f-9a1f-89f06f821460 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Going to run 1 instances... {{(pid=123546) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 05 02:55:53.006394 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-e40c2d9e-18a5-4e2f-9a1f-89f06f821460 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] [instance: ec6e78b4-5147-4f9b-84ce-c5d5ec0bd30d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='adbc7df1-116e-4f9f-a28d-a6a3c084cceb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123546) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 05 02:55:53.064944 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-e40c2d9e-18a5-4e2f-9a1f-89f06f821460 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.753514 Mar 05 02:55:53.065601 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 237/490] 10.222.0.26 () {60 vars in 1146 bytes} [Sat Mar 5 02:55:52 2022] POST /compute/v2.1/servers => generated 401 bytes in 755 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 05 02:55:53.076458 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-47e47dab-6d25-40dd-84e5-8428c371e8cf tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:55:53.077071 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-47e47dab-6d25-40dd-84e5-8428c371e8cf tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] [instance: ec6e78b4-5147-4f9b-84ce-c5d5ec0bd30d] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:55:53.136077 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-47e47dab-6d25-40dd-84e5-8428c371e8cf tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af8fb7f45f4d4eb180ccaca3d52ed2dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dd2b27540c04b4c8741ce8c9a5e2b47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:55:53.143753 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-47e47dab-6d25-40dd-84e5-8428c371e8cf tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] 10.222.0.26 "GET /compute/v2.1/servers/ec6e78b4-5147-4f9b-84ce-c5d5ec0bd30d" status: 200 len: 1242 microversion: 2.1 time: 0.072180 Mar 05 02:55:53.144658 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 254/491] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:55:53 2022] GET /compute/v2.1/servers/ec6e78b4-5147-4f9b-84ce-c5d5ec0bd30d => generated 1242 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 02:55:53.692253 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-849a3841-eb58-445a-9583-908c18623904 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:55:53.693573 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-849a3841-eb58-445a-9583-908c18623904 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] [instance: d0080e4b-6532-4e0c-8d19-cfbdf32e401b] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:55:53.704654 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-849a3841-eb58-445a-9583-908c18623904 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:55:53.705113 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-849a3841-eb58-445a-9583-908c18623904 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:55:53.705922 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-849a3841-eb58-445a-9583-908c18623904 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:55:53.706445 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-849a3841-eb58-445a-9583-908c18623904 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:55:53.894642 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-849a3841-eb58-445a-9583-908c18623904 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e5a000087fe40419ccd0d1a96fb4783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9d27da2e71d4962a53a95efc46518ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:55:53.905156 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-849a3841-eb58-445a-9583-908c18623904 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] 10.222.0.26 "GET /compute/v2.1/servers/d0080e4b-6532-4e0c-8d19-cfbdf32e401b" status: 200 len: 1678 microversion: 2.1 time: 0.216933 Mar 05 02:55:53.906093 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 238/492] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:55:53 2022] GET /compute/v2.1/servers/d0080e4b-6532-4e0c-8d19-cfbdf32e401b => generated 1678 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 02:55:53.974141 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-4e09cf06-f77d-436f-97bc-b9936aa1df7f tempest-VolumesSnapshotTestJSON-729970751 tempest-VolumesSnapshotTestJSON-729970751-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:55:53.975389 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-4e09cf06-f77d-436f-97bc-b9936aa1df7f tempest-VolumesSnapshotTestJSON-729970751 tempest-VolumesSnapshotTestJSON-729970751-project] [instance: 110e5aaf-5b65-47ec-8a04-b48155049cf5] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:55:53.985108 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-4e09cf06-f77d-436f-97bc-b9936aa1df7f tempest-VolumesSnapshotTestJSON-729970751 tempest-VolumesSnapshotTestJSON-729970751-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:55:53.985563 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-4e09cf06-f77d-436f-97bc-b9936aa1df7f tempest-VolumesSnapshotTestJSON-729970751 tempest-VolumesSnapshotTestJSON-729970751-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:55:53.986431 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-4e09cf06-f77d-436f-97bc-b9936aa1df7f tempest-VolumesSnapshotTestJSON-729970751 tempest-VolumesSnapshotTestJSON-729970751-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:55:53.987023 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-4e09cf06-f77d-436f-97bc-b9936aa1df7f tempest-VolumesSnapshotTestJSON-729970751 tempest-VolumesSnapshotTestJSON-729970751-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:55:54.103847 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [req-b0863ec6-a4e4-4546-ad14-6e5587a1a7af req-b57b2f84-24c7-458a-ba50-4b716c482aee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "110e5aaf-5b65-47ec-8a04-b48155049cf5", "name": "network-vif-plugged", "status": "completed", "tag": "7d66b0a8-f21d-42f8-a151-dddba94a3dfe"}]} {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 02:55:54.121091 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [req-b0863ec6-a4e4-4546-ad14-6e5587a1a7af req-b57b2f84-24c7-458a-ba50-4b716c482aee service nova] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:55:54.121980 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [req-b0863ec6-a4e4-4546-ad14-6e5587a1a7af req-b57b2f84-24c7-458a-ba50-4b716c482aee service nova] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:55:54.162001 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.compute.server_external_events [req-b0863ec6-a4e4-4546-ad14-6e5587a1a7af req-b57b2f84-24c7-458a-ba50-4b716c482aee service nova] Creating event network-vif-plugged:7d66b0a8-f21d-42f8-a151-dddba94a3dfe for instance 110e5aaf-5b65-47ec-8a04-b48155049cf5 on hv-cinder-82725 Mar 05 02:55:54.173020 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [req-b0863ec6-a4e4-4546-ad14-6e5587a1a7af req-b57b2f84-24c7-458a-ba50-4b716c482aee service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072962 Mar 05 02:55:54.174089 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 239/493] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Mar 5 02:55:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 05 02:55:54.181400 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-c68211b6-c936-488c-a91d-a88ec18cd52f tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:55:54.182214 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-c68211b6-c936-488c-a91d-a88ec18cd52f tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] [instance: ec6e78b4-5147-4f9b-84ce-c5d5ec0bd30d] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:55:54.196520 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-c68211b6-c936-488c-a91d-a88ec18cd52f tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:55:54.200645 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-c68211b6-c936-488c-a91d-a88ec18cd52f tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:55:54.201023 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-4e09cf06-f77d-436f-97bc-b9936aa1df7f tempest-VolumesSnapshotTestJSON-729970751 tempest-VolumesSnapshotTestJSON-729970751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84de0440c1444309d9c9b6c706bae73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8efa5f5dbc9f460aa91f4f62eb57abee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:55:54.202341 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-c68211b6-c936-488c-a91d-a88ec18cd52f tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:55:54.205547 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-c68211b6-c936-488c-a91d-a88ec18cd52f tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:55:54.211384 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-4e09cf06-f77d-436f-97bc-b9936aa1df7f tempest-VolumesSnapshotTestJSON-729970751 tempest-VolumesSnapshotTestJSON-729970751-project] 10.222.0.26 "GET /compute/v2.1/servers/110e5aaf-5b65-47ec-8a04-b48155049cf5" status: 200 len: 1319 microversion: 2.1 time: 0.242650 Mar 05 02:55:54.216238 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 255/494] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:55:53 2022] GET /compute/v2.1/servers/110e5aaf-5b65-47ec-8a04-b48155049cf5 => generated 1319 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 02:55:54.334180 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-c68211b6-c936-488c-a91d-a88ec18cd52f tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af8fb7f45f4d4eb180ccaca3d52ed2dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dd2b27540c04b4c8741ce8c9a5e2b47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:55:54.346338 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-c68211b6-c936-488c-a91d-a88ec18cd52f tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] 10.222.0.26 "GET /compute/v2.1/servers/ec6e78b4-5147-4f9b-84ce-c5d5ec0bd30d" status: 200 len: 1302 microversion: 2.1 time: 0.170728 Mar 05 02:55:54.349337 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 240/495] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:55:54 2022] GET /compute/v2.1/servers/ec6e78b4-5147-4f9b-84ce-c5d5ec0bd30d => generated 1302 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 02:55:54.923702 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-08c84da4-76cf-4330-adae-040366d36bac tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:55:54.924515 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-08c84da4-76cf-4330-adae-040366d36bac tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] [instance: d0080e4b-6532-4e0c-8d19-cfbdf32e401b] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:55:54.931546 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-08c84da4-76cf-4330-adae-040366d36bac tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:55:54.932115 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-08c84da4-76cf-4330-adae-040366d36bac tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:55:54.933129 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-08c84da4-76cf-4330-adae-040366d36bac tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:55:54.933835 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-08c84da4-76cf-4330-adae-040366d36bac tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:55:55.197851 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-08c84da4-76cf-4330-adae-040366d36bac tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e5a000087fe40419ccd0d1a96fb4783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9d27da2e71d4962a53a95efc46518ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:55:55.205783 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-08c84da4-76cf-4330-adae-040366d36bac tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] 10.222.0.26 "GET /compute/v2.1/servers/d0080e4b-6532-4e0c-8d19-cfbdf32e401b" status: 200 len: 1678 microversion: 2.1 time: 0.286252 Mar 05 02:55:55.206382 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 256/496] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:55:54 2022] GET /compute/v2.1/servers/d0080e4b-6532-4e0c-8d19-cfbdf32e401b => generated 1678 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 02:55:55.233018 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-4bfd0080-3bfa-4449-b6d9-ec987cfe61a2 tempest-VolumesSnapshotTestJSON-729970751 tempest-VolumesSnapshotTestJSON-729970751-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:55:55.241102 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-4bfd0080-3bfa-4449-b6d9-ec987cfe61a2 tempest-VolumesSnapshotTestJSON-729970751 tempest-VolumesSnapshotTestJSON-729970751-project] [instance: 110e5aaf-5b65-47ec-8a04-b48155049cf5] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:55:55.248657 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-4bfd0080-3bfa-4449-b6d9-ec987cfe61a2 tempest-VolumesSnapshotTestJSON-729970751 tempest-VolumesSnapshotTestJSON-729970751-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:55:55.249309 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-4bfd0080-3bfa-4449-b6d9-ec987cfe61a2 tempest-VolumesSnapshotTestJSON-729970751 tempest-VolumesSnapshotTestJSON-729970751-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:55:55.250147 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-4bfd0080-3bfa-4449-b6d9-ec987cfe61a2 tempest-VolumesSnapshotTestJSON-729970751 tempest-VolumesSnapshotTestJSON-729970751-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:55:55.250582 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-4bfd0080-3bfa-4449-b6d9-ec987cfe61a2 tempest-VolumesSnapshotTestJSON-729970751 tempest-VolumesSnapshotTestJSON-729970751-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:55:55.365190 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-0a145f7e-283a-4847-a56a-085453419570 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:55:55.365811 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-0a145f7e-283a-4847-a56a-085453419570 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] [instance: ec6e78b4-5147-4f9b-84ce-c5d5ec0bd30d] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:55:55.372165 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-0a145f7e-283a-4847-a56a-085453419570 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:55:55.372865 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-0a145f7e-283a-4847-a56a-085453419570 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:55:55.374462 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-0a145f7e-283a-4847-a56a-085453419570 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:55:55.375070 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-0a145f7e-283a-4847-a56a-085453419570 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:55:55.544115 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-4bfd0080-3bfa-4449-b6d9-ec987cfe61a2 tempest-VolumesSnapshotTestJSON-729970751 tempest-VolumesSnapshotTestJSON-729970751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84de0440c1444309d9c9b6c706bae73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8efa5f5dbc9f460aa91f4f62eb57abee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:55:55.551264 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-4bfd0080-3bfa-4449-b6d9-ec987cfe61a2 tempest-VolumesSnapshotTestJSON-729970751 tempest-VolumesSnapshotTestJSON-729970751-project] 10.222.0.26 "GET /compute/v2.1/servers/110e5aaf-5b65-47ec-8a04-b48155049cf5" status: 200 len: 1319 microversion: 2.1 time: 0.322735 Mar 05 02:55:55.551833 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 241/497] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:55:55 2022] GET /compute/v2.1/servers/110e5aaf-5b65-47ec-8a04-b48155049cf5 => generated 1319 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 02:55:55.654245 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-0a145f7e-283a-4847-a56a-085453419570 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af8fb7f45f4d4eb180ccaca3d52ed2dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dd2b27540c04b4c8741ce8c9a5e2b47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:55:55.661742 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-0a145f7e-283a-4847-a56a-085453419570 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] 10.222.0.26 "GET /compute/v2.1/servers/ec6e78b4-5147-4f9b-84ce-c5d5ec0bd30d" status: 200 len: 1367 microversion: 2.1 time: 0.300415 Mar 05 02:55:55.662354 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 257/498] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:55:55 2022] GET /compute/v2.1/servers/ec6e78b4-5147-4f9b-84ce-c5d5ec0bd30d => generated 1367 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 02:55:55.916319 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [req-6e564ae1-43e8-4a1d-a8a1-3c10f8d577d0 req-8b659ad4-0b0d-4964-8b5a-58161e6ce8ab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ec6e78b4-5147-4f9b-84ce-c5d5ec0bd30d", "tag": "4bb7ff98-132f-4f56-866f-09d5d21c9a76"}]} {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 02:55:55.935558 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [req-6e564ae1-43e8-4a1d-a8a1-3c10f8d577d0 req-8b659ad4-0b0d-4964-8b5a-58161e6ce8ab service nova] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:55:55.937919 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [req-6e564ae1-43e8-4a1d-a8a1-3c10f8d577d0 req-8b659ad4-0b0d-4964-8b5a-58161e6ce8ab service nova] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:55:55.952522 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.compute.server_external_events [req-6e564ae1-43e8-4a1d-a8a1-3c10f8d577d0 req-8b659ad4-0b0d-4964-8b5a-58161e6ce8ab service nova] Creating event network-changed:4bb7ff98-132f-4f56-866f-09d5d21c9a76 for instance ec6e78b4-5147-4f9b-84ce-c5d5ec0bd30d on hv-cinder-82725 Mar 05 02:55:55.957890 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [req-6e564ae1-43e8-4a1d-a8a1-3c10f8d577d0 req-8b659ad4-0b0d-4964-8b5a-58161e6ce8ab service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046711 Mar 05 02:55:55.958784 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 242/499] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Mar 5 02:55:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 02:55:56.222591 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-53438ea5-c85f-4bc2-882d-b5e394a59f03 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:55:56.223219 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-53438ea5-c85f-4bc2-882d-b5e394a59f03 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] [instance: d0080e4b-6532-4e0c-8d19-cfbdf32e401b] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:55:56.229659 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-53438ea5-c85f-4bc2-882d-b5e394a59f03 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:55:56.230144 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-53438ea5-c85f-4bc2-882d-b5e394a59f03 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:55:56.231573 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-53438ea5-c85f-4bc2-882d-b5e394a59f03 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:55:56.232016 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-53438ea5-c85f-4bc2-882d-b5e394a59f03 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:55:56.569726 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-d52dcb41-4f2d-4e9c-9afb-dd3e220543a5 tempest-VolumesSnapshotTestJSON-729970751 tempest-VolumesSnapshotTestJSON-729970751-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:55:56.570495 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-d52dcb41-4f2d-4e9c-9afb-dd3e220543a5 tempest-VolumesSnapshotTestJSON-729970751 tempest-VolumesSnapshotTestJSON-729970751-project] [instance: 110e5aaf-5b65-47ec-8a04-b48155049cf5] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:55:56.577485 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-d52dcb41-4f2d-4e9c-9afb-dd3e220543a5 tempest-VolumesSnapshotTestJSON-729970751 tempest-VolumesSnapshotTestJSON-729970751-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:55:56.577933 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-d52dcb41-4f2d-4e9c-9afb-dd3e220543a5 tempest-VolumesSnapshotTestJSON-729970751 tempest-VolumesSnapshotTestJSON-729970751-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:55:56.578745 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-d52dcb41-4f2d-4e9c-9afb-dd3e220543a5 tempest-VolumesSnapshotTestJSON-729970751 tempest-VolumesSnapshotTestJSON-729970751-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:55:56.579178 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-d52dcb41-4f2d-4e9c-9afb-dd3e220543a5 tempest-VolumesSnapshotTestJSON-729970751 tempest-VolumesSnapshotTestJSON-729970751-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:55:56.704545 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-53438ea5-c85f-4bc2-882d-b5e394a59f03 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e5a000087fe40419ccd0d1a96fb4783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9d27da2e71d4962a53a95efc46518ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:55:56.712737 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-53438ea5-c85f-4bc2-882d-b5e394a59f03 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] 10.222.0.26 "GET /compute/v2.1/servers/d0080e4b-6532-4e0c-8d19-cfbdf32e401b" status: 200 len: 1678 microversion: 2.1 time: 0.493417 Mar 05 02:55:56.723186 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 258/500] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:55:56 2022] GET /compute/v2.1/servers/d0080e4b-6532-4e0c-8d19-cfbdf32e401b => generated 1678 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 02:55:56.723186 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-2b6ae9b6-4168-4759-bb77-dc481e8cca71 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:55:56.723186 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-2b6ae9b6-4168-4759-bb77-dc481e8cca71 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] [instance: ec6e78b4-5147-4f9b-84ce-c5d5ec0bd30d] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:55:56.732569 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-2b6ae9b6-4168-4759-bb77-dc481e8cca71 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:55:56.733018 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-2b6ae9b6-4168-4759-bb77-dc481e8cca71 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:55:56.733802 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-2b6ae9b6-4168-4759-bb77-dc481e8cca71 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:55:56.734590 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-2b6ae9b6-4168-4759-bb77-dc481e8cca71 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:55:56.811026 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-d52dcb41-4f2d-4e9c-9afb-dd3e220543a5 tempest-VolumesSnapshotTestJSON-729970751 tempest-VolumesSnapshotTestJSON-729970751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84de0440c1444309d9c9b6c706bae73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8efa5f5dbc9f460aa91f4f62eb57abee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:55:56.818199 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-d52dcb41-4f2d-4e9c-9afb-dd3e220543a5 tempest-VolumesSnapshotTestJSON-729970751 tempest-VolumesSnapshotTestJSON-729970751-project] 10.222.0.26 "GET /compute/v2.1/servers/110e5aaf-5b65-47ec-8a04-b48155049cf5" status: 200 len: 1508 microversion: 2.1 time: 0.253153 Mar 05 02:55:56.818769 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 243/501] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:55:56 2022] GET /compute/v2.1/servers/110e5aaf-5b65-47ec-8a04-b48155049cf5 => generated 1508 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 02:55:56.835826 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-f88f6880-e1d4-4672-b103-f570c09cd4e2 tempest-VolumesSnapshotTestJSON-729970751 tempest-VolumesSnapshotTestJSON-729970751-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f33c133f-4d4d-4e7d-bb75-f6f001918677", "device": "/dev/sdb"}} {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 02:55:56.837406 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-f88f6880-e1d4-4672-b103-f570c09cd4e2 tempest-VolumesSnapshotTestJSON-729970751 tempest-VolumesSnapshotTestJSON-729970751-project] [instance: 110e5aaf-5b65-47ec-8a04-b48155049cf5] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:55:56.843621 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-f88f6880-e1d4-4672-b103-f570c09cd4e2 tempest-VolumesSnapshotTestJSON-729970751 tempest-VolumesSnapshotTestJSON-729970751-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:55:56.844073 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-f88f6880-e1d4-4672-b103-f570c09cd4e2 tempest-VolumesSnapshotTestJSON-729970751 tempest-VolumesSnapshotTestJSON-729970751-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:55:56.844844 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-f88f6880-e1d4-4672-b103-f570c09cd4e2 tempest-VolumesSnapshotTestJSON-729970751 tempest-VolumesSnapshotTestJSON-729970751-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:55:56.845282 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-f88f6880-e1d4-4672-b103-f570c09cd4e2 tempest-VolumesSnapshotTestJSON-729970751 tempest-VolumesSnapshotTestJSON-729970751-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:55:56.966411 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-2b6ae9b6-4168-4759-bb77-dc481e8cca71 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af8fb7f45f4d4eb180ccaca3d52ed2dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dd2b27540c04b4c8741ce8c9a5e2b47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:55:56.974837 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-2b6ae9b6-4168-4759-bb77-dc481e8cca71 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] 10.222.0.26 "GET /compute/v2.1/servers/ec6e78b4-5147-4f9b-84ce-c5d5ec0bd30d" status: 200 len: 1367 microversion: 2.1 time: 0.260237 Mar 05 02:55:56.975480 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 259/502] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:55:56 2022] GET /compute/v2.1/servers/ec6e78b4-5147-4f9b-84ce-c5d5ec0bd30d => generated 1367 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 02:55:57.092623 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-f88f6880-e1d4-4672-b103-f570c09cd4e2 tempest-VolumesSnapshotTestJSON-729970751 tempest-VolumesSnapshotTestJSON-729970751-project] 10.222.0.26 "POST /compute/v2.1/servers/110e5aaf-5b65-47ec-8a04-b48155049cf5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.260473 Mar 05 02:55:57.094238 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 244/503] 10.222.0.26 () {60 vars in 1322 bytes} [Sat Mar 5 02:55:56 2022] POST /compute/v2.1/servers/110e5aaf-5b65-47ec-8a04-b48155049cf5/os-volume_attachments => generated 194 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 05 02:55:57.731380 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-bf26eea6-6b80-417a-bb91-c8182ed0e90d tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:55:57.732115 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-bf26eea6-6b80-417a-bb91-c8182ed0e90d tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] [instance: d0080e4b-6532-4e0c-8d19-cfbdf32e401b] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:55:57.738410 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-bf26eea6-6b80-417a-bb91-c8182ed0e90d tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:55:57.738858 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-bf26eea6-6b80-417a-bb91-c8182ed0e90d tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:55:57.739620 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-bf26eea6-6b80-417a-bb91-c8182ed0e90d tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:55:57.740052 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-bf26eea6-6b80-417a-bb91-c8182ed0e90d tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:55:57.875094 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-bf26eea6-6b80-417a-bb91-c8182ed0e90d tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e5a000087fe40419ccd0d1a96fb4783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9d27da2e71d4962a53a95efc46518ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:55:57.882225 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-bf26eea6-6b80-417a-bb91-c8182ed0e90d tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] 10.222.0.26 "GET /compute/v2.1/servers/d0080e4b-6532-4e0c-8d19-cfbdf32e401b" status: 200 len: 1678 microversion: 2.1 time: 0.155614 Mar 05 02:55:57.882791 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 260/504] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:55:57 2022] GET /compute/v2.1/servers/d0080e4b-6532-4e0c-8d19-cfbdf32e401b => generated 1678 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 02:55:57.992947 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-4a2fc62e-b455-4e3e-b0e6-9d2e008b08fe tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:55:57.993636 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-4a2fc62e-b455-4e3e-b0e6-9d2e008b08fe tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] [instance: ec6e78b4-5147-4f9b-84ce-c5d5ec0bd30d] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:55:57.999828 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-4a2fc62e-b455-4e3e-b0e6-9d2e008b08fe tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:55:58.000274 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-4a2fc62e-b455-4e3e-b0e6-9d2e008b08fe tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:55:58.001040 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-4a2fc62e-b455-4e3e-b0e6-9d2e008b08fe tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:55:58.001571 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-4a2fc62e-b455-4e3e-b0e6-9d2e008b08fe tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:55:58.134066 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-4a2fc62e-b455-4e3e-b0e6-9d2e008b08fe tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af8fb7f45f4d4eb180ccaca3d52ed2dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dd2b27540c04b4c8741ce8c9a5e2b47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:55:58.141965 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-4a2fc62e-b455-4e3e-b0e6-9d2e008b08fe tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] 10.222.0.26 "GET /compute/v2.1/servers/ec6e78b4-5147-4f9b-84ce-c5d5ec0bd30d" status: 200 len: 1367 microversion: 2.1 time: 0.153642 Mar 05 02:55:58.142541 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 245/505] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:55:57 2022] GET /compute/v2.1/servers/ec6e78b4-5147-4f9b-84ce-c5d5ec0bd30d => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 02:55:58.900595 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-5ceae9fd-0c65-4320-8b9b-64d730ccf9a6 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:55:58.901198 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-5ceae9fd-0c65-4320-8b9b-64d730ccf9a6 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] [instance: d0080e4b-6532-4e0c-8d19-cfbdf32e401b] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:55:58.908001 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-5ceae9fd-0c65-4320-8b9b-64d730ccf9a6 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:55:58.908451 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-5ceae9fd-0c65-4320-8b9b-64d730ccf9a6 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:55:58.909209 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-5ceae9fd-0c65-4320-8b9b-64d730ccf9a6 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:55:58.909638 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-5ceae9fd-0c65-4320-8b9b-64d730ccf9a6 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:55:59.041454 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-5ceae9fd-0c65-4320-8b9b-64d730ccf9a6 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e5a000087fe40419ccd0d1a96fb4783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9d27da2e71d4962a53a95efc46518ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:55:59.048900 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-5ceae9fd-0c65-4320-8b9b-64d730ccf9a6 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] 10.222.0.26 "GET /compute/v2.1/servers/d0080e4b-6532-4e0c-8d19-cfbdf32e401b" status: 200 len: 1678 microversion: 2.1 time: 0.152179 Mar 05 02:55:59.049466 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 261/506] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:55:58 2022] GET /compute/v2.1/servers/d0080e4b-6532-4e0c-8d19-cfbdf32e401b => generated 1678 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 02:55:59.158309 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-cfbd682e-4636-4996-a70d-ea48c35a88cc tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:55:59.158901 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-cfbd682e-4636-4996-a70d-ea48c35a88cc tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] [instance: ec6e78b4-5147-4f9b-84ce-c5d5ec0bd30d] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:55:59.165041 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-cfbd682e-4636-4996-a70d-ea48c35a88cc tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:55:59.165491 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-cfbd682e-4636-4996-a70d-ea48c35a88cc tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:55:59.166284 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-cfbd682e-4636-4996-a70d-ea48c35a88cc tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:55:59.166719 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-cfbd682e-4636-4996-a70d-ea48c35a88cc tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:55:59.300971 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-cfbd682e-4636-4996-a70d-ea48c35a88cc tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af8fb7f45f4d4eb180ccaca3d52ed2dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dd2b27540c04b4c8741ce8c9a5e2b47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:55:59.308107 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-cfbd682e-4636-4996-a70d-ea48c35a88cc tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] 10.222.0.26 "GET /compute/v2.1/servers/ec6e78b4-5147-4f9b-84ce-c5d5ec0bd30d" status: 200 len: 1367 microversion: 2.1 time: 0.153638 Mar 05 02:55:59.309166 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 246/507] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:55:59 2022] GET /compute/v2.1/servers/ec6e78b4-5147-4f9b-84ce-c5d5ec0bd30d => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 02:56:00.066272 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-3373385e-423b-4435-bdee-d57c83023b08 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:56:00.066893 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-3373385e-423b-4435-bdee-d57c83023b08 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] [instance: d0080e4b-6532-4e0c-8d19-cfbdf32e401b] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:56:00.072998 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-3373385e-423b-4435-bdee-d57c83023b08 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:56:00.073429 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-3373385e-423b-4435-bdee-d57c83023b08 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:56:00.074252 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-3373385e-423b-4435-bdee-d57c83023b08 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:56:00.075336 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-3373385e-423b-4435-bdee-d57c83023b08 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:56:00.206970 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-3373385e-423b-4435-bdee-d57c83023b08 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e5a000087fe40419ccd0d1a96fb4783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9d27da2e71d4962a53a95efc46518ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:56:00.214183 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-3373385e-423b-4435-bdee-d57c83023b08 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] 10.222.0.26 "GET /compute/v2.1/servers/d0080e4b-6532-4e0c-8d19-cfbdf32e401b" status: 200 len: 1655 microversion: 2.1 time: 0.152196 Mar 05 02:56:00.214742 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 262/508] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:56:00 2022] GET /compute/v2.1/servers/d0080e4b-6532-4e0c-8d19-cfbdf32e401b => generated 1655 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 02:56:00.231627 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-1e8d72b8-41e4-4319-8826-27c8f5f7eb4e tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 02:56:00.238106 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-1e8d72b8-41e4-4319-8826-27c8f5f7eb4e tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:56:00.238556 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-1e8d72b8-41e4-4319-8826-27c8f5f7eb4e tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:56:00.259485 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-1e8d72b8-41e4-4319-8826-27c8f5f7eb4e tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] [instance: d0080e4b-6532-4e0c-8d19-cfbdf32e401b] Going to try to start instance {{(pid=123546) start /opt/stack/nova/nova/compute/api.py:2730}} Mar 05 02:56:00.309798 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-1e8d72b8-41e4-4319-8826-27c8f5f7eb4e tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] 10.222.0.26 "POST /compute/v2.1/servers/d0080e4b-6532-4e0c-8d19-cfbdf32e401b/action" status: 202 len: 0 microversion: 2.1 time: 0.081903 Mar 05 02:56:00.310516 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 247/509] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Mar 5 02:56:00 2022] POST /compute/v2.1/servers/d0080e4b-6532-4e0c-8d19-cfbdf32e401b/action => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 05 02:56:00.320113 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-3620d439-c6da-4b32-94b4-3edd0128660d tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:56:00.320871 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-3620d439-c6da-4b32-94b4-3edd0128660d tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] [instance: d0080e4b-6532-4e0c-8d19-cfbdf32e401b] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:56:00.328854 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-2e8c3ef4-229d-4d67-95e1-31a66d4c6ca5 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:56:00.329608 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-2e8c3ef4-229d-4d67-95e1-31a66d4c6ca5 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] [instance: ec6e78b4-5147-4f9b-84ce-c5d5ec0bd30d] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:56:00.330602 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-3620d439-c6da-4b32-94b4-3edd0128660d tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:56:00.331100 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-3620d439-c6da-4b32-94b4-3edd0128660d tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:56:00.331874 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-3620d439-c6da-4b32-94b4-3edd0128660d tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:56:00.332878 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-3620d439-c6da-4b32-94b4-3edd0128660d tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:56:00.338000 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-2e8c3ef4-229d-4d67-95e1-31a66d4c6ca5 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:56:00.338452 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-2e8c3ef4-229d-4d67-95e1-31a66d4c6ca5 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:56:00.339591 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-2e8c3ef4-229d-4d67-95e1-31a66d4c6ca5 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:56:00.340025 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-2e8c3ef4-229d-4d67-95e1-31a66d4c6ca5 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:56:00.615256 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-3620d439-c6da-4b32-94b4-3edd0128660d tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e5a000087fe40419ccd0d1a96fb4783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9d27da2e71d4962a53a95efc46518ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:56:00.622443 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-3620d439-c6da-4b32-94b4-3edd0128660d tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] 10.222.0.26 "GET /compute/v2.1/servers/d0080e4b-6532-4e0c-8d19-cfbdf32e401b" status: 200 len: 1664 microversion: 2.1 time: 0.307639 Mar 05 02:56:00.623011 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 263/510] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:56:00 2022] GET /compute/v2.1/servers/d0080e4b-6532-4e0c-8d19-cfbdf32e401b => generated 1664 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 02:56:00.645595 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-2e8c3ef4-229d-4d67-95e1-31a66d4c6ca5 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af8fb7f45f4d4eb180ccaca3d52ed2dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dd2b27540c04b4c8741ce8c9a5e2b47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:56:00.652735 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-2e8c3ef4-229d-4d67-95e1-31a66d4c6ca5 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] 10.222.0.26 "GET /compute/v2.1/servers/ec6e78b4-5147-4f9b-84ce-c5d5ec0bd30d" status: 200 len: 1367 microversion: 2.1 time: 0.330606 Mar 05 02:56:00.653306 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 248/511] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:56:00 2022] GET /compute/v2.1/servers/ec6e78b4-5147-4f9b-84ce-c5d5ec0bd30d => generated 1367 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 02:56:01.641215 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-fc91303d-58e2-4ef9-9148-b67ab5df924f tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:56:01.641849 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-fc91303d-58e2-4ef9-9148-b67ab5df924f tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] [instance: d0080e4b-6532-4e0c-8d19-cfbdf32e401b] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:56:01.648259 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-fc91303d-58e2-4ef9-9148-b67ab5df924f tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:56:01.648714 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-fc91303d-58e2-4ef9-9148-b67ab5df924f tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:56:01.649489 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-fc91303d-58e2-4ef9-9148-b67ab5df924f tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:56:01.650170 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-fc91303d-58e2-4ef9-9148-b67ab5df924f tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:56:01.669750 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-ab81651a-9fdd-4312-af78-51dbf821848e tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:56:01.670412 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-ab81651a-9fdd-4312-af78-51dbf821848e tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] [instance: ec6e78b4-5147-4f9b-84ce-c5d5ec0bd30d] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:56:01.677695 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-ab81651a-9fdd-4312-af78-51dbf821848e tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:56:01.677695 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-ab81651a-9fdd-4312-af78-51dbf821848e tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:56:01.677695 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-ab81651a-9fdd-4312-af78-51dbf821848e tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:56:01.678256 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-ab81651a-9fdd-4312-af78-51dbf821848e tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:56:01.864644 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-fc91303d-58e2-4ef9-9148-b67ab5df924f tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e5a000087fe40419ccd0d1a96fb4783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9d27da2e71d4962a53a95efc46518ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:56:01.867012 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-ab81651a-9fdd-4312-af78-51dbf821848e tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af8fb7f45f4d4eb180ccaca3d52ed2dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dd2b27540c04b4c8741ce8c9a5e2b47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:56:01.873406 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-fc91303d-58e2-4ef9-9148-b67ab5df924f tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] 10.222.0.26 "GET /compute/v2.1/servers/d0080e4b-6532-4e0c-8d19-cfbdf32e401b" status: 200 len: 1668 microversion: 2.1 time: 0.237268 Mar 05 02:56:01.874687 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 264/512] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:56:01 2022] GET /compute/v2.1/servers/d0080e4b-6532-4e0c-8d19-cfbdf32e401b => generated 1668 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 02:56:01.875218 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-ab81651a-9fdd-4312-af78-51dbf821848e tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] 10.222.0.26 "GET /compute/v2.1/servers/ec6e78b4-5147-4f9b-84ce-c5d5ec0bd30d" status: 200 len: 1367 microversion: 2.1 time: 0.207929 Mar 05 02:56:01.875994 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 249/513] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:56:01 2022] GET /compute/v2.1/servers/ec6e78b4-5147-4f9b-84ce-c5d5ec0bd30d => generated 1367 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 02:56:01.999651 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [req-d86dbcc5-440d-47bf-8f26-914ff0c0da9e req-f11726f4-9080-41db-9a4d-e1974de4573d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec6e78b4-5147-4f9b-84ce-c5d5ec0bd30d", "name": "network-vif-plugged", "status": "completed", "tag": "4bb7ff98-132f-4f56-866f-09d5d21c9a76"}]} {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 02:56:02.008055 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [req-d86dbcc5-440d-47bf-8f26-914ff0c0da9e req-f11726f4-9080-41db-9a4d-e1974de4573d service nova] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:56:02.008652 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [req-d86dbcc5-440d-47bf-8f26-914ff0c0da9e req-f11726f4-9080-41db-9a4d-e1974de4573d service nova] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:56:02.019456 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.compute.server_external_events [req-d86dbcc5-440d-47bf-8f26-914ff0c0da9e req-f11726f4-9080-41db-9a4d-e1974de4573d service nova] Creating event network-vif-plugged:4bb7ff98-132f-4f56-866f-09d5d21c9a76 for instance ec6e78b4-5147-4f9b-84ce-c5d5ec0bd30d on hv-cinder-82725 Mar 05 02:56:02.024407 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [req-d86dbcc5-440d-47bf-8f26-914ff0c0da9e req-f11726f4-9080-41db-9a4d-e1974de4573d service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028598 Mar 05 02:56:02.025076 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 265/514] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Mar 5 02:56:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 02:56:02.892377 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-3b97642b-f605-4eca-8b9c-6f326bb2ea10 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:56:02.892984 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-3b97642b-f605-4eca-8b9c-6f326bb2ea10 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] [instance: ec6e78b4-5147-4f9b-84ce-c5d5ec0bd30d] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:56:02.899262 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-3b97642b-f605-4eca-8b9c-6f326bb2ea10 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:56:02.899712 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-3b97642b-f605-4eca-8b9c-6f326bb2ea10 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:56:02.900472 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-3b97642b-f605-4eca-8b9c-6f326bb2ea10 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:56:02.900898 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-3b97642b-f605-4eca-8b9c-6f326bb2ea10 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:56:03.033339 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-3b97642b-f605-4eca-8b9c-6f326bb2ea10 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af8fb7f45f4d4eb180ccaca3d52ed2dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dd2b27540c04b4c8741ce8c9a5e2b47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:56:03.040455 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-3b97642b-f605-4eca-8b9c-6f326bb2ea10 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] 10.222.0.26 "GET /compute/v2.1/servers/ec6e78b4-5147-4f9b-84ce-c5d5ec0bd30d" status: 200 len: 1367 microversion: 2.1 time: 0.152614 Mar 05 02:56:03.041037 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 250/515] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:56:02 2022] GET /compute/v2.1/servers/ec6e78b4-5147-4f9b-84ce-c5d5ec0bd30d => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 02:56:04.057587 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-11052272-f31d-4a61-8588-c38c708920f4 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:56:04.058300 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-11052272-f31d-4a61-8588-c38c708920f4 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] [instance: ec6e78b4-5147-4f9b-84ce-c5d5ec0bd30d] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:56:04.064403 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-11052272-f31d-4a61-8588-c38c708920f4 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:56:04.064848 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-11052272-f31d-4a61-8588-c38c708920f4 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:56:04.065634 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-11052272-f31d-4a61-8588-c38c708920f4 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:56:04.066087 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-11052272-f31d-4a61-8588-c38c708920f4 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:56:04.195999 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-11052272-f31d-4a61-8588-c38c708920f4 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af8fb7f45f4d4eb180ccaca3d52ed2dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dd2b27540c04b4c8741ce8c9a5e2b47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:56:04.204115 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-11052272-f31d-4a61-8588-c38c708920f4 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] 10.222.0.26 "GET /compute/v2.1/servers/ec6e78b4-5147-4f9b-84ce-c5d5ec0bd30d" status: 200 len: 1556 microversion: 2.1 time: 0.151241 Mar 05 02:56:04.204684 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 266/516] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:56:04 2022] GET /compute/v2.1/servers/ec6e78b4-5147-4f9b-84ce-c5d5ec0bd30d => generated 1556 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 02:56:04.220022 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-b85f0395-2d2b-4d6d-b3b9-cb4a1192ee03 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:56:04.220539 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-b85f0395-2d2b-4d6d-b3b9-cb4a1192ee03 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] [instance: ec6e78b4-5147-4f9b-84ce-c5d5ec0bd30d] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:56:04.226786 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-b85f0395-2d2b-4d6d-b3b9-cb4a1192ee03 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:56:04.227440 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-b85f0395-2d2b-4d6d-b3b9-cb4a1192ee03 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:56:04.228991 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-b85f0395-2d2b-4d6d-b3b9-cb4a1192ee03 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:56:04.229769 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-b85f0395-2d2b-4d6d-b3b9-cb4a1192ee03 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:56:04.315104 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-b85f0395-2d2b-4d6d-b3b9-cb4a1192ee03 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] 10.222.0.26 "GET /compute/v2.1/servers/ec6e78b4-5147-4f9b-84ce-c5d5ec0bd30d/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.098856 Mar 05 02:56:04.315699 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 251/517] 10.222.0.26 () {58 vars in 1274 bytes} [Sat Mar 5 02:56:04 2022] GET /compute/v2.1/servers/ec6e78b4-5147-4f9b-84ce-c5d5ec0bd30d/os-interface => generated 284 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 02:56:05.279013 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [req-d3f188b8-cc2b-4577-be90-617417f80a02 req-89c9a224-f630-405d-bf3a-6eff4175186d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ec6e78b4-5147-4f9b-84ce-c5d5ec0bd30d", "tag": "4bb7ff98-132f-4f56-866f-09d5d21c9a76"}]} {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 02:56:05.288113 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [req-d3f188b8-cc2b-4577-be90-617417f80a02 req-89c9a224-f630-405d-bf3a-6eff4175186d service nova] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:56:05.288550 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [req-d3f188b8-cc2b-4577-be90-617417f80a02 req-89c9a224-f630-405d-bf3a-6eff4175186d service nova] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:56:05.299233 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.compute.server_external_events [req-d3f188b8-cc2b-4577-be90-617417f80a02 req-89c9a224-f630-405d-bf3a-6eff4175186d service nova] Creating event network-changed:4bb7ff98-132f-4f56-866f-09d5d21c9a76 for instance ec6e78b4-5147-4f9b-84ce-c5d5ec0bd30d on hv-cinder-82725 Mar 05 02:56:05.303919 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [req-d3f188b8-cc2b-4577-be90-617417f80a02 req-89c9a224-f630-405d-bf3a-6eff4175186d service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028631 Mar 05 02:56:05.304510 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 267/518] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Mar 5 02:56:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 02:56:07.916187 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-adf38a73-35c9-4126-be9f-efcb36af5846 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:56:07.916775 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-adf38a73-35c9-4126-be9f-efcb36af5846 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] [instance: e28e570d-3d50-4fe8-bb4a-fe0e95c20fb7] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:56:07.923280 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-adf38a73-35c9-4126-be9f-efcb36af5846 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:56:07.923725 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-adf38a73-35c9-4126-be9f-efcb36af5846 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:56:07.924494 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-adf38a73-35c9-4126-be9f-efcb36af5846 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:56:07.924928 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-adf38a73-35c9-4126-be9f-efcb36af5846 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:56:07.953156 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-adf38a73-35c9-4126-be9f-efcb36af5846 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] 10.222.0.26 "GET /compute/v2.1/servers/e28e570d-3d50-4fe8-bb4a-fe0e95c20fb7/os-volume_attachments/cd9baecf-cd8c-48c1-a01f-64e74a21aa5a" status: 200 len: 194 microversion: 2.20 time: 0.041290 Mar 05 02:56:07.954075 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 252/519] 10.222.0.26 () {60 vars in 1453 bytes} [Sat Mar 5 02:56:07 2022] GET /compute/v2.1/servers/e28e570d-3d50-4fe8-bb4a-fe0e95c20fb7/os-volume_attachments/cd9baecf-cd8c-48c1-a01f-64e74a21aa5a => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 05 02:56:08.026356 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-175a7eab-7e49-4d09-89fa-e88db431a548 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:56:08.027005 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-175a7eab-7e49-4d09-89fa-e88db431a548 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] [instance: e28e570d-3d50-4fe8-bb4a-fe0e95c20fb7] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:56:08.034322 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-175a7eab-7e49-4d09-89fa-e88db431a548 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:56:08.034768 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-175a7eab-7e49-4d09-89fa-e88db431a548 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:56:08.035780 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-175a7eab-7e49-4d09-89fa-e88db431a548 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:56:08.036362 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-175a7eab-7e49-4d09-89fa-e88db431a548 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:56:08.116051 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.objects.instance [None req-175a7eab-7e49-4d09-89fa-e88db431a548 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lazy-loading 'services' on Instance uuid e28e570d-3d50-4fe8-bb4a-fe0e95c20fb7 {{(pid=123545) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 05 02:56:08.185543 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-175a7eab-7e49-4d09-89fa-e88db431a548 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] 10.222.0.26 "DELETE /compute/v2.1/servers/e28e570d-3d50-4fe8-bb4a-fe0e95c20fb7/os-volume_attachments/cd9baecf-cd8c-48c1-a01f-64e74a21aa5a" status: 202 len: 0 microversion: 2.20 time: 0.164993 Mar 05 02:56:08.186210 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 268/520] 10.222.0.26 () {60 vars in 1456 bytes} [Sat Mar 5 02:56:08 2022] DELETE /compute/v2.1/servers/e28e570d-3d50-4fe8-bb4a-fe0e95c20fb7/os-volume_attachments/cd9baecf-cd8c-48c1-a01f-64e74a21aa5a => generated 0 bytes in 167 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Mar 05 02:56:08.194682 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-c1c1a1e1-8bec-4f59-aaf8-823f447e58b7 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:56:08.195648 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-c1c1a1e1-8bec-4f59-aaf8-823f447e58b7 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] [instance: e28e570d-3d50-4fe8-bb4a-fe0e95c20fb7] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:56:08.201869 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-c1c1a1e1-8bec-4f59-aaf8-823f447e58b7 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:56:08.202356 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-c1c1a1e1-8bec-4f59-aaf8-823f447e58b7 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:56:08.203132 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-c1c1a1e1-8bec-4f59-aaf8-823f447e58b7 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:56:08.203783 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-c1c1a1e1-8bec-4f59-aaf8-823f447e58b7 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:56:08.235040 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-c1c1a1e1-8bec-4f59-aaf8-823f447e58b7 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] 10.222.0.26 "GET /compute/v2.1/servers/e28e570d-3d50-4fe8-bb4a-fe0e95c20fb7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044420 Mar 05 02:56:08.235623 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 253/521] 10.222.0.26 () {60 vars in 1342 bytes} [Sat Mar 5 02:56:08 2022] GET /compute/v2.1/servers/e28e570d-3d50-4fe8-bb4a-fe0e95c20fb7/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 05 02:56:09.247256 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-06855bbc-40b9-4e19-8ec4-2d3a414a9ef4 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:56:09.248313 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-06855bbc-40b9-4e19-8ec4-2d3a414a9ef4 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] [instance: e28e570d-3d50-4fe8-bb4a-fe0e95c20fb7] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:56:09.255158 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-06855bbc-40b9-4e19-8ec4-2d3a414a9ef4 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:56:09.255602 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-06855bbc-40b9-4e19-8ec4-2d3a414a9ef4 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:56:09.256386 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-06855bbc-40b9-4e19-8ec4-2d3a414a9ef4 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:56:09.256818 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-06855bbc-40b9-4e19-8ec4-2d3a414a9ef4 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:56:09.283856 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-06855bbc-40b9-4e19-8ec4-2d3a414a9ef4 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] 10.222.0.26 "GET /compute/v2.1/servers/e28e570d-3d50-4fe8-bb4a-fe0e95c20fb7/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.041481 Mar 05 02:56:09.284399 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 269/522] 10.222.0.26 () {60 vars in 1342 bytes} [Sat Mar 5 02:56:09 2022] GET /compute/v2.1/servers/e28e570d-3d50-4fe8-bb4a-fe0e95c20fb7/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 02:56:09.340381 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-897d02e0-a1d0-47c2-b219-885e935aeb02 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:56:09.341051 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-897d02e0-a1d0-47c2-b219-885e935aeb02 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] [instance: e28e570d-3d50-4fe8-bb4a-fe0e95c20fb7] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:56:09.347236 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-897d02e0-a1d0-47c2-b219-885e935aeb02 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:56:09.347690 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-897d02e0-a1d0-47c2-b219-885e935aeb02 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:56:09.348463 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-897d02e0-a1d0-47c2-b219-885e935aeb02 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:56:09.348906 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-897d02e0-a1d0-47c2-b219-885e935aeb02 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:56:09.375574 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-897d02e0-a1d0-47c2-b219-885e935aeb02 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] [instance: e28e570d-3d50-4fe8-bb4a-fe0e95c20fb7] Going to try to terminate instance {{(pid=123546) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 05 02:56:09.448241 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-897d02e0-a1d0-47c2-b219-885e935aeb02 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] 10.222.0.26 "DELETE /compute/v2.1/servers/e28e570d-3d50-4fe8-bb4a-fe0e95c20fb7" status: 204 len: 0 microversion: 2.20 time: 0.111488 Mar 05 02:56:09.448724 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 254/523] 10.222.0.26 () {60 vars in 1279 bytes} [Sat Mar 5 02:56:09 2022] DELETE /compute/v2.1/servers/e28e570d-3d50-4fe8-bb4a-fe0e95c20fb7 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Mar 05 02:56:09.457043 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-949d0936-8ba1-42e5-a894-dfae30b0f749 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:56:09.457678 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-949d0936-8ba1-42e5-a894-dfae30b0f749 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] [instance: e28e570d-3d50-4fe8-bb4a-fe0e95c20fb7] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:56:09.463424 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-949d0936-8ba1-42e5-a894-dfae30b0f749 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:56:09.463877 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-949d0936-8ba1-42e5-a894-dfae30b0f749 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:56:09.464641 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-949d0936-8ba1-42e5-a894-dfae30b0f749 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:56:09.465075 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-949d0936-8ba1-42e5-a894-dfae30b0f749 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:56:09.594701 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-949d0936-8ba1-42e5-a894-dfae30b0f749 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:56:09.602275 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-949d0936-8ba1-42e5-a894-dfae30b0f749 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:56:09.604042 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-949d0936-8ba1-42e5-a894-dfae30b0f749 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:56:09.605185 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-949d0936-8ba1-42e5-a894-dfae30b0f749 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] 10.222.0.26 "GET /compute/v2.1/servers/e28e570d-3d50-4fe8-bb4a-fe0e95c20fb7" status: 200 len: 1723 microversion: 2.20 time: 0.152044 Mar 05 02:56:09.605746 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 270/524] 10.222.0.26 () {60 vars in 1276 bytes} [Sat Mar 5 02:56:09 2022] GET /compute/v2.1/servers/e28e570d-3d50-4fe8-bb4a-fe0e95c20fb7 => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 05 02:56:10.625491 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-5fdc743f-0dbb-4d4c-973e-4613e4f5339c tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:56:10.626210 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-5fdc743f-0dbb-4d4c-973e-4613e4f5339c tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] [instance: e28e570d-3d50-4fe8-bb4a-fe0e95c20fb7] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:56:10.632380 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-5fdc743f-0dbb-4d4c-973e-4613e4f5339c tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:56:10.632824 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-5fdc743f-0dbb-4d4c-973e-4613e4f5339c tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:56:10.633588 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-5fdc743f-0dbb-4d4c-973e-4613e4f5339c tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:56:10.634044 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-5fdc743f-0dbb-4d4c-973e-4613e4f5339c tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:56:10.770705 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-5fdc743f-0dbb-4d4c-973e-4613e4f5339c tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:56:10.778312 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-5fdc743f-0dbb-4d4c-973e-4613e4f5339c tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:56:10.779853 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-5fdc743f-0dbb-4d4c-973e-4613e4f5339c tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:56:10.780998 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-5fdc743f-0dbb-4d4c-973e-4613e4f5339c tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] 10.222.0.26 "GET /compute/v2.1/servers/e28e570d-3d50-4fe8-bb4a-fe0e95c20fb7" status: 200 len: 1723 microversion: 2.20 time: 0.160479 Mar 05 02:56:10.781552 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 255/525] 10.222.0.26 () {60 vars in 1276 bytes} [Sat Mar 5 02:56:10 2022] GET /compute/v2.1/servers/e28e570d-3d50-4fe8-bb4a-fe0e95c20fb7 => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 02:56:11.799475 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-5252a7f2-8158-4998-b706-a19ead8833da tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:56:11.800081 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-5252a7f2-8158-4998-b706-a19ead8833da tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] [instance: e28e570d-3d50-4fe8-bb4a-fe0e95c20fb7] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:56:11.806435 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-5252a7f2-8158-4998-b706-a19ead8833da tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:56:11.806890 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-5252a7f2-8158-4998-b706-a19ead8833da tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:56:11.807656 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-5252a7f2-8158-4998-b706-a19ead8833da tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:56:11.808092 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-5252a7f2-8158-4998-b706-a19ead8833da tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:56:11.938948 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-5252a7f2-8158-4998-b706-a19ead8833da tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:56:11.946550 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-5252a7f2-8158-4998-b706-a19ead8833da tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:56:11.948034 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-5252a7f2-8158-4998-b706-a19ead8833da tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:56:11.949177 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-5252a7f2-8158-4998-b706-a19ead8833da tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] 10.222.0.26 "GET /compute/v2.1/servers/e28e570d-3d50-4fe8-bb4a-fe0e95c20fb7" status: 200 len: 1723 microversion: 2.20 time: 0.153698 Mar 05 02:56:11.949733 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 271/526] 10.222.0.26 () {60 vars in 1276 bytes} [Sat Mar 5 02:56:11 2022] GET /compute/v2.1/servers/e28e570d-3d50-4fe8-bb4a-fe0e95c20fb7 => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 02:56:12.968243 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-38ef43e0-1587-462b-b97f-6400af171aa0 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:56:12.968893 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-38ef43e0-1587-462b-b97f-6400af171aa0 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] [instance: e28e570d-3d50-4fe8-bb4a-fe0e95c20fb7] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:56:12.975424 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-38ef43e0-1587-462b-b97f-6400af171aa0 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:56:12.975886 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-38ef43e0-1587-462b-b97f-6400af171aa0 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:56:12.976655 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-38ef43e0-1587-462b-b97f-6400af171aa0 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:56:12.977094 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-38ef43e0-1587-462b-b97f-6400af171aa0 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:56:13.112979 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-38ef43e0-1587-462b-b97f-6400af171aa0 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:56:13.121572 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-38ef43e0-1587-462b-b97f-6400af171aa0 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:56:13.123182 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-38ef43e0-1587-462b-b97f-6400af171aa0 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:56:13.124395 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-38ef43e0-1587-462b-b97f-6400af171aa0 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] 10.222.0.26 "GET /compute/v2.1/servers/e28e570d-3d50-4fe8-bb4a-fe0e95c20fb7" status: 200 len: 1723 microversion: 2.20 time: 0.160310 Mar 05 02:56:13.124968 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 256/527] 10.222.0.26 () {60 vars in 1276 bytes} [Sat Mar 5 02:56:12 2022] GET /compute/v2.1/servers/e28e570d-3d50-4fe8-bb4a-fe0e95c20fb7 => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 02:56:14.144434 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-3a3d9ff5-cfc4-4c2e-a281-79186fd92589 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:56:14.144817 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-3a3d9ff5-cfc4-4c2e-a281-79186fd92589 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] [instance: e28e570d-3d50-4fe8-bb4a-fe0e95c20fb7] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:56:14.151320 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-3a3d9ff5-cfc4-4c2e-a281-79186fd92589 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:56:14.151769 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-3a3d9ff5-cfc4-4c2e-a281-79186fd92589 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:56:14.152567 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-3a3d9ff5-cfc4-4c2e-a281-79186fd92589 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:56:14.152998 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-3a3d9ff5-cfc4-4c2e-a281-79186fd92589 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:56:14.660024 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-3a3d9ff5-cfc4-4c2e-a281-79186fd92589 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:56:14.667734 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-3a3d9ff5-cfc4-4c2e-a281-79186fd92589 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:56:14.669256 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-3a3d9ff5-cfc4-4c2e-a281-79186fd92589 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:56:14.670444 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-3a3d9ff5-cfc4-4c2e-a281-79186fd92589 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] 10.222.0.26 "GET /compute/v2.1/servers/e28e570d-3d50-4fe8-bb4a-fe0e95c20fb7" status: 200 len: 1723 microversion: 2.20 time: 0.531737 Mar 05 02:56:14.671611 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 272/528] 10.222.0.26 () {60 vars in 1276 bytes} [Sat Mar 5 02:56:14 2022] GET /compute/v2.1/servers/e28e570d-3d50-4fe8-bb4a-fe0e95c20fb7 => generated 1723 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 02:56:15.094267 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [req-f94803e6-a6b3-45f7-a0ce-40e8b3bc664f req-fbdd54c8-3498-44ab-ac72-3cf5e3be44ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e28e570d-3d50-4fe8-bb4a-fe0e95c20fb7", "name": "network-vif-deleted", "tag": "f280dd1a-3e15-49a1-9569-b6b40278e2a2"}]} {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 02:56:15.105056 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [req-f94803e6-a6b3-45f7-a0ce-40e8b3bc664f req-fbdd54c8-3498-44ab-ac72-3cf5e3be44ef service nova] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:56:15.106317 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [req-f94803e6-a6b3-45f7-a0ce-40e8b3bc664f req-fbdd54c8-3498-44ab-ac72-3cf5e3be44ef service nova] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:56:15.119104 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.compute.server_external_events [req-f94803e6-a6b3-45f7-a0ce-40e8b3bc664f req-fbdd54c8-3498-44ab-ac72-3cf5e3be44ef service nova] Creating event network-vif-deleted:f280dd1a-3e15-49a1-9569-b6b40278e2a2 for instance e28e570d-3d50-4fe8-bb4a-fe0e95c20fb7 on hv-cinder-82725 Mar 05 02:56:15.125747 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [req-f94803e6-a6b3-45f7-a0ce-40e8b3bc664f req-fbdd54c8-3498-44ab-ac72-3cf5e3be44ef service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036036 Mar 05 02:56:15.126970 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 257/529] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Mar 5 02:56:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 02:56:15.690932 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-8291eac1-4e21-4d52-99b4-ec05d10bd6b1 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:56:15.691540 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-8291eac1-4e21-4d52-99b4-ec05d10bd6b1 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] [instance: e28e570d-3d50-4fe8-bb4a-fe0e95c20fb7] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:56:15.697797 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-8291eac1-4e21-4d52-99b4-ec05d10bd6b1 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:56:15.698265 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-8291eac1-4e21-4d52-99b4-ec05d10bd6b1 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:56:15.699036 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-8291eac1-4e21-4d52-99b4-ec05d10bd6b1 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:56:15.699457 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-8291eac1-4e21-4d52-99b4-ec05d10bd6b1 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:56:15.713360 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.wsgi [None req-8291eac1-4e21-4d52-99b4-ec05d10bd6b1 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] HTTP exception thrown: Instance e28e570d-3d50-4fe8-bb4a-fe0e95c20fb7 could not be found. Mar 05 02:56:15.713985 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-8291eac1-4e21-4d52-99b4-ec05d10bd6b1 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Returning 404 to user: Instance e28e570d-3d50-4fe8-bb4a-fe0e95c20fb7 could not be found. {{(pid=123545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 02:56:15.714890 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-8291eac1-4e21-4d52-99b4-ec05d10bd6b1 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] 10.222.0.26 "GET /compute/v2.1/servers/e28e570d-3d50-4fe8-bb4a-fe0e95c20fb7" status: 404 len: 111 microversion: 2.20 time: 0.028920 Mar 05 02:56:15.715430 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 273/530] 10.222.0.26 () {60 vars in 1276 bytes} [Sat Mar 5 02:56:15 2022] GET /compute/v2.1/servers/e28e570d-3d50-4fe8-bb4a-fe0e95c20fb7 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Mar 05 02:56:15.724956 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-2414bdf5-75a7-4f5a-8b8e-84efd1b17521 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Calling method '.version_select at 0x7f3f61d67ca0>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:56:15.743843 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-2414bdf5-75a7-4f5a-8b8e-84efd1b17521 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-919844124" status: 204 len: 0 microversion: 2.20 time: 0.023078 Mar 05 02:56:15.744660 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 258/531] 10.222.0.26 () {60 vars in 1258 bytes} [Sat Mar 5 02:56:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-919844124 => generated 0 bytes in 25 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Mar 05 02:56:16.372755 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-2fd78e8b-775c-490a-acca-8a8876afaa6e tempest-VolumesSnapshotTestJSON-729970751 tempest-VolumesSnapshotTestJSON-729970751-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:56:16.373335 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-2fd78e8b-775c-490a-acca-8a8876afaa6e tempest-VolumesSnapshotTestJSON-729970751 tempest-VolumesSnapshotTestJSON-729970751-project] [instance: 110e5aaf-5b65-47ec-8a04-b48155049cf5] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:56:16.381491 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-2fd78e8b-775c-490a-acca-8a8876afaa6e tempest-VolumesSnapshotTestJSON-729970751 tempest-VolumesSnapshotTestJSON-729970751-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:56:16.381934 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-2fd78e8b-775c-490a-acca-8a8876afaa6e tempest-VolumesSnapshotTestJSON-729970751 tempest-VolumesSnapshotTestJSON-729970751-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:56:16.383122 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-2fd78e8b-775c-490a-acca-8a8876afaa6e tempest-VolumesSnapshotTestJSON-729970751 tempest-VolumesSnapshotTestJSON-729970751-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:56:16.383564 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-2fd78e8b-775c-490a-acca-8a8876afaa6e tempest-VolumesSnapshotTestJSON-729970751 tempest-VolumesSnapshotTestJSON-729970751-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:56:16.414405 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-807116b0-3a81-4cb0-a0b7-6b8a924c0b23 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Action: 'create', calling method: .version_select at 0x7f3f61de3430>, body: {"keypair": {"name": "tempest-keypair-547835302"}} {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 02:56:16.432179 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.quota [None req-807116b0-3a81-4cb0-a0b7-6b8a924c0b23 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Getting quotas for project 533ddcf7f3bc4068a6f2856eb915ecb2. Resources: {'key_pairs'} {{(pid=123546) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 02:56:16.438401 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.quota [None req-807116b0-3a81-4cb0-a0b7-6b8a924c0b23 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Getting quotas for user c599ce47ad9147d29c93e3984b9652a8 and project 533ddcf7f3bc4068a6f2856eb915ecb2. Resources: {'key_pairs'} {{(pid=123546) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 02:56:16.476013 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.objects.instance [None req-2fd78e8b-775c-490a-acca-8a8876afaa6e tempest-VolumesSnapshotTestJSON-729970751 tempest-VolumesSnapshotTestJSON-729970751-project] Lazy-loading 'services' on Instance uuid 110e5aaf-5b65-47ec-8a04-b48155049cf5 {{(pid=123545) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 05 02:56:16.543180 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.quota [None req-807116b0-3a81-4cb0-a0b7-6b8a924c0b23 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Getting quotas for project 533ddcf7f3bc4068a6f2856eb915ecb2. Resources: {'key_pairs'} {{(pid=123546) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 02:56:16.549330 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.quota [None req-807116b0-3a81-4cb0-a0b7-6b8a924c0b23 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Getting quotas for user c599ce47ad9147d29c93e3984b9652a8 and project 533ddcf7f3bc4068a6f2856eb915ecb2. Resources: {'key_pairs'} {{(pid=123546) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 02:56:16.550101 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-2fd78e8b-775c-490a-acca-8a8876afaa6e tempest-VolumesSnapshotTestJSON-729970751 tempest-VolumesSnapshotTestJSON-729970751-project] 10.222.0.26 "DELETE /compute/v2.1/servers/110e5aaf-5b65-47ec-8a04-b48155049cf5/os-volume_attachments/f33c133f-4d4d-4e7d-bb75-f6f001918677" status: 202 len: 0 microversion: 2.1 time: 0.181500 Mar 05 02:56:16.550746 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 274/532] 10.222.0.26 () {58 vars in 1415 bytes} [Sat Mar 5 02:56:16 2022] DELETE /compute/v2.1/servers/110e5aaf-5b65-47ec-8a04-b48155049cf5/os-volume_attachments/f33c133f-4d4d-4e7d-bb75-f6f001918677 => generated 0 bytes in 183 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Mar 05 02:56:16.574380 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-807116b0-3a81-4cb0-a0b7-6b8a924c0b23 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 201 len: 2319 microversion: 2.20 time: 0.163487 Mar 05 02:56:16.574946 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 259/533] 10.222.0.26 () {62 vars in 1198 bytes} [Sat Mar 5 02:56:16 2022] POST /compute/v2.1/os-keypairs => generated 2319 bytes in 165 msecs (HTTP/1.1 201) 9 headers in 365 bytes (2 switches on core 0) Mar 05 02:56:17.665104 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-fb0eedd0-b50d-48ac-996e-fd2e998f1bdf tempest-VolumesSnapshotTestJSON-729970751 tempest-VolumesSnapshotTestJSON-729970751-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:56:17.665685 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-fb0eedd0-b50d-48ac-996e-fd2e998f1bdf tempest-VolumesSnapshotTestJSON-729970751 tempest-VolumesSnapshotTestJSON-729970751-project] [instance: 110e5aaf-5b65-47ec-8a04-b48155049cf5] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:56:17.672917 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-fb0eedd0-b50d-48ac-996e-fd2e998f1bdf tempest-VolumesSnapshotTestJSON-729970751 tempest-VolumesSnapshotTestJSON-729970751-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:56:17.673371 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-fb0eedd0-b50d-48ac-996e-fd2e998f1bdf tempest-VolumesSnapshotTestJSON-729970751 tempest-VolumesSnapshotTestJSON-729970751-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:56:17.678406 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-fb0eedd0-b50d-48ac-996e-fd2e998f1bdf tempest-VolumesSnapshotTestJSON-729970751 tempest-VolumesSnapshotTestJSON-729970751-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:56:17.679125 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-fb0eedd0-b50d-48ac-996e-fd2e998f1bdf tempest-VolumesSnapshotTestJSON-729970751 tempest-VolumesSnapshotTestJSON-729970751-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:56:17.706923 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-fb0eedd0-b50d-48ac-996e-fd2e998f1bdf tempest-VolumesSnapshotTestJSON-729970751 tempest-VolumesSnapshotTestJSON-729970751-project] [instance: 110e5aaf-5b65-47ec-8a04-b48155049cf5] Going to try to terminate instance {{(pid=123545) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 05 02:56:17.806480 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-fb0eedd0-b50d-48ac-996e-fd2e998f1bdf tempest-VolumesSnapshotTestJSON-729970751 tempest-VolumesSnapshotTestJSON-729970751-project] 10.222.0.26 "DELETE /compute/v2.1/servers/110e5aaf-5b65-47ec-8a04-b48155049cf5" status: 204 len: 0 microversion: 2.1 time: 0.145509 Mar 05 02:56:17.807547 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 275/534] 10.222.0.26 () {58 vars in 1238 bytes} [Sat Mar 5 02:56:17 2022] DELETE /compute/v2.1/servers/110e5aaf-5b65-47ec-8a04-b48155049cf5 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 05 02:56:17.818603 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-c690a9a4-20e5-4bac-b505-df88f17d0297 tempest-VolumesSnapshotTestJSON-729970751 tempest-VolumesSnapshotTestJSON-729970751-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:56:17.819353 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-c690a9a4-20e5-4bac-b505-df88f17d0297 tempest-VolumesSnapshotTestJSON-729970751 tempest-VolumesSnapshotTestJSON-729970751-project] [instance: 110e5aaf-5b65-47ec-8a04-b48155049cf5] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:56:17.828317 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-c690a9a4-20e5-4bac-b505-df88f17d0297 tempest-VolumesSnapshotTestJSON-729970751 tempest-VolumesSnapshotTestJSON-729970751-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:56:17.828938 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-c690a9a4-20e5-4bac-b505-df88f17d0297 tempest-VolumesSnapshotTestJSON-729970751 tempest-VolumesSnapshotTestJSON-729970751-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:56:17.829769 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-c690a9a4-20e5-4bac-b505-df88f17d0297 tempest-VolumesSnapshotTestJSON-729970751 tempest-VolumesSnapshotTestJSON-729970751-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:56:17.830257 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-c690a9a4-20e5-4bac-b505-df88f17d0297 tempest-VolumesSnapshotTestJSON-729970751 tempest-VolumesSnapshotTestJSON-729970751-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:56:17.929891 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-cfd291f7-a7cf-40ce-b96c-0c3f3ef0a65c tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-842927304", "imageRef": "adbc7df1-116e-4f9f-a28d-a6a3c084cceb", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "0e12fae2-ecda-45fd-a83a-e67cf08123e5"}], "security_groups": [{"name": "tempest-securitygroup--232497155"}], "key_name": "tempest-keypair-547835302", "user_data": "}} {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 02:56:17.991325 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-c690a9a4-20e5-4bac-b505-df88f17d0297 tempest-VolumesSnapshotTestJSON-729970751 tempest-VolumesSnapshotTestJSON-729970751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84de0440c1444309d9c9b6c706bae73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8efa5f5dbc9f460aa91f4f62eb57abee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:56:17.998868 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-c690a9a4-20e5-4bac-b505-df88f17d0297 tempest-VolumesSnapshotTestJSON-729970751 tempest-VolumesSnapshotTestJSON-729970751-project] 10.222.0.26 "GET /compute/v2.1/servers/110e5aaf-5b65-47ec-8a04-b48155049cf5" status: 200 len: 1514 microversion: 2.1 time: 0.186355 Mar 05 02:56:18.009299 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 260/535] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:56:17 2022] GET /compute/v2.1/servers/110e5aaf-5b65-47ec-8a04-b48155049cf5 => generated 1514 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 02:56:18.061456 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.network.neutron [None req-cfd291f7-a7cf-40ce-b96c-0c3f3ef0a65c tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] validate_networks() for [('0e12fae2-ecda-45fd-a83a-e67cf08123e5', None, None, None, None, None)] {{(pid=123545) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 05 02:56:18.431851 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.virt.hardware [None req-cfd291f7-a7cf-40ce-b96c-0c3f3ef0a65c tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Flavor limits 0:0:0 {{(pid=123545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 05 02:56:18.432279 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.virt.hardware [None req-cfd291f7-a7cf-40ce-b96c-0c3f3ef0a65c tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Image limits 0:0:0 {{(pid=123545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 05 02:56:18.432788 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.virt.hardware [None req-cfd291f7-a7cf-40ce-b96c-0c3f3ef0a65c tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Flavor pref 0:0:0 {{(pid=123545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 05 02:56:18.433248 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.virt.hardware [None req-cfd291f7-a7cf-40ce-b96c-0c3f3ef0a65c tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Image pref 0:0:0 {{(pid=123545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 05 02:56:18.433612 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.virt.hardware [None req-cfd291f7-a7cf-40ce-b96c-0c3f3ef0a65c tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 05 02:56:18.442977 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-cfd291f7-a7cf-40ce-b96c-0c3f3ef0a65c tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:56:18.443442 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-cfd291f7-a7cf-40ce-b96c-0c3f3ef0a65c tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:56:18.444269 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-cfd291f7-a7cf-40ce-b96c-0c3f3ef0a65c tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:56:18.444708 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-cfd291f7-a7cf-40ce-b96c-0c3f3ef0a65c tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:56:18.461457 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.quota [None req-cfd291f7-a7cf-40ce-b96c-0c3f3ef0a65c tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Getting quotas for project 533ddcf7f3bc4068a6f2856eb915ecb2. Resources: {'ram', 'cores', 'instances'} {{(pid=123545) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 02:56:18.465406 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.quota [None req-cfd291f7-a7cf-40ce-b96c-0c3f3ef0a65c tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Getting quotas for user c599ce47ad9147d29c93e3984b9652a8 and project 533ddcf7f3bc4068a6f2856eb915ecb2. Resources: {'ram', 'cores', 'instances'} {{(pid=123545) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 02:56:18.477085 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-cfd291f7-a7cf-40ce-b96c-0c3f3ef0a65c tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Going to run 1 instances... {{(pid=123545) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 05 02:56:18.479764 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-cfd291f7-a7cf-40ce-b96c-0c3f3ef0a65c tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] [instance: 1b31d7bf-888c-45a2-bc3a-e7077ad3a96d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='adbc7df1-116e-4f9f-a28d-a6a3c084cceb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123545) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 05 02:56:18.524738 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-cfd291f7-a7cf-40ce-b96c-0c3f3ef0a65c tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.599982 Mar 05 02:56:18.525574 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 276/536] 10.222.0.26 () {62 vars in 1187 bytes} [Sat Mar 5 02:56:17 2022] POST /compute/v2.1/servers => generated 401 bytes in 601 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Mar 05 02:56:18.536613 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-e532b931-3e07-4726-9073-1d04ec3fc1ef tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:56:18.537293 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-e532b931-3e07-4726-9073-1d04ec3fc1ef tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] [instance: 1b31d7bf-888c-45a2-bc3a-e7077ad3a96d] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:56:18.594586 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-e532b931-3e07-4726-9073-1d04ec3fc1ef tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:56:18.601624 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-e532b931-3e07-4726-9073-1d04ec3fc1ef tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:56:18.603096 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-e532b931-3e07-4726-9073-1d04ec3fc1ef tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:56:18.604464 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-e532b931-3e07-4726-9073-1d04ec3fc1ef tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] 10.222.0.26 "GET /compute/v2.1/servers/1b31d7bf-888c-45a2-bc3a-e7077ad3a96d" status: 200 len: 1280 microversion: 2.20 time: 0.071818 Mar 05 02:56:18.605039 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 261/537] 10.222.0.26 () {60 vars in 1276 bytes} [Sat Mar 5 02:56:18 2022] GET /compute/v2.1/servers/1b31d7bf-888c-45a2-bc3a-e7077ad3a96d => generated 1280 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 02:56:19.017440 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-deee2014-16a1-4812-a265-1a13c128d4b5 tempest-VolumesSnapshotTestJSON-729970751 tempest-VolumesSnapshotTestJSON-729970751-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:56:19.018083 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-deee2014-16a1-4812-a265-1a13c128d4b5 tempest-VolumesSnapshotTestJSON-729970751 tempest-VolumesSnapshotTestJSON-729970751-project] [instance: 110e5aaf-5b65-47ec-8a04-b48155049cf5] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:56:19.024632 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-deee2014-16a1-4812-a265-1a13c128d4b5 tempest-VolumesSnapshotTestJSON-729970751 tempest-VolumesSnapshotTestJSON-729970751-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:56:19.025086 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-deee2014-16a1-4812-a265-1a13c128d4b5 tempest-VolumesSnapshotTestJSON-729970751 tempest-VolumesSnapshotTestJSON-729970751-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:56:19.025857 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-deee2014-16a1-4812-a265-1a13c128d4b5 tempest-VolumesSnapshotTestJSON-729970751 tempest-VolumesSnapshotTestJSON-729970751-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:56:19.026330 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-deee2014-16a1-4812-a265-1a13c128d4b5 tempest-VolumesSnapshotTestJSON-729970751 tempest-VolumesSnapshotTestJSON-729970751-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:56:19.164952 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-deee2014-16a1-4812-a265-1a13c128d4b5 tempest-VolumesSnapshotTestJSON-729970751 tempest-VolumesSnapshotTestJSON-729970751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84de0440c1444309d9c9b6c706bae73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8efa5f5dbc9f460aa91f4f62eb57abee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:56:19.173192 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-deee2014-16a1-4812-a265-1a13c128d4b5 tempest-VolumesSnapshotTestJSON-729970751 tempest-VolumesSnapshotTestJSON-729970751-project] 10.222.0.26 "GET /compute/v2.1/servers/110e5aaf-5b65-47ec-8a04-b48155049cf5" status: 200 len: 1514 microversion: 2.1 time: 0.160564 Mar 05 02:56:19.173769 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 277/538] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:56:19 2022] GET /compute/v2.1/servers/110e5aaf-5b65-47ec-8a04-b48155049cf5 => generated 1514 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 02:56:19.624084 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-45b4e575-ba84-4843-bd65-ac64a83b3e00 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:56:19.624889 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-45b4e575-ba84-4843-bd65-ac64a83b3e00 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] [instance: 1b31d7bf-888c-45a2-bc3a-e7077ad3a96d] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:56:19.632198 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-45b4e575-ba84-4843-bd65-ac64a83b3e00 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:56:19.632746 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-45b4e575-ba84-4843-bd65-ac64a83b3e00 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:56:19.633597 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-45b4e575-ba84-4843-bd65-ac64a83b3e00 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:56:19.634068 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-45b4e575-ba84-4843-bd65-ac64a83b3e00 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:56:19.735992 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-45b4e575-ba84-4843-bd65-ac64a83b3e00 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:56:19.743953 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-45b4e575-ba84-4843-bd65-ac64a83b3e00 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:56:19.745466 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-45b4e575-ba84-4843-bd65-ac64a83b3e00 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:56:19.746601 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-45b4e575-ba84-4843-bd65-ac64a83b3e00 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] 10.222.0.26 "GET /compute/v2.1/servers/1b31d7bf-888c-45a2-bc3a-e7077ad3a96d" status: 200 len: 1338 microversion: 2.20 time: 0.126489 Mar 05 02:56:19.747169 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 262/539] 10.222.0.26 () {60 vars in 1276 bytes} [Sat Mar 5 02:56:19 2022] GET /compute/v2.1/servers/1b31d7bf-888c-45a2-bc3a-e7077ad3a96d => generated 1338 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 02:56:20.190308 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-73dacb70-beb3-4572-a182-c5f963d54b77 tempest-VolumesSnapshotTestJSON-729970751 tempest-VolumesSnapshotTestJSON-729970751-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:56:20.190922 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-73dacb70-beb3-4572-a182-c5f963d54b77 tempest-VolumesSnapshotTestJSON-729970751 tempest-VolumesSnapshotTestJSON-729970751-project] [instance: 110e5aaf-5b65-47ec-8a04-b48155049cf5] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:56:20.197184 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-73dacb70-beb3-4572-a182-c5f963d54b77 tempest-VolumesSnapshotTestJSON-729970751 tempest-VolumesSnapshotTestJSON-729970751-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:56:20.197636 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-73dacb70-beb3-4572-a182-c5f963d54b77 tempest-VolumesSnapshotTestJSON-729970751 tempest-VolumesSnapshotTestJSON-729970751-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:56:20.198487 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-73dacb70-beb3-4572-a182-c5f963d54b77 tempest-VolumesSnapshotTestJSON-729970751 tempest-VolumesSnapshotTestJSON-729970751-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:56:20.198925 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-73dacb70-beb3-4572-a182-c5f963d54b77 tempest-VolumesSnapshotTestJSON-729970751 tempest-VolumesSnapshotTestJSON-729970751-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:56:20.450789 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-73dacb70-beb3-4572-a182-c5f963d54b77 tempest-VolumesSnapshotTestJSON-729970751 tempest-VolumesSnapshotTestJSON-729970751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84de0440c1444309d9c9b6c706bae73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8efa5f5dbc9f460aa91f4f62eb57abee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:56:20.458751 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-73dacb70-beb3-4572-a182-c5f963d54b77 tempest-VolumesSnapshotTestJSON-729970751 tempest-VolumesSnapshotTestJSON-729970751-project] 10.222.0.26 "GET /compute/v2.1/servers/110e5aaf-5b65-47ec-8a04-b48155049cf5" status: 200 len: 1514 microversion: 2.1 time: 0.272675 Mar 05 02:56:20.459417 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 278/540] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:56:20 2022] GET /compute/v2.1/servers/110e5aaf-5b65-47ec-8a04-b48155049cf5 => generated 1514 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 02:56:20.571159 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [req-112d2c7c-09d6-448b-bafe-d44446bb8b8b req-aa931457-97bd-4627-9039-af1b4c6d3f57 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "110e5aaf-5b65-47ec-8a04-b48155049cf5", "name": "network-vif-deleted", "tag": "7d66b0a8-f21d-42f8-a151-dddba94a3dfe"}]} {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 02:56:20.588646 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [req-112d2c7c-09d6-448b-bafe-d44446bb8b8b req-aa931457-97bd-4627-9039-af1b4c6d3f57 service nova] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:56:20.589568 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [req-112d2c7c-09d6-448b-bafe-d44446bb8b8b req-aa931457-97bd-4627-9039-af1b4c6d3f57 service nova] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:56:20.616060 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.compute.server_external_events [req-112d2c7c-09d6-448b-bafe-d44446bb8b8b req-aa931457-97bd-4627-9039-af1b4c6d3f57 service nova] Creating event network-vif-deleted:7d66b0a8-f21d-42f8-a151-dddba94a3dfe for instance 110e5aaf-5b65-47ec-8a04-b48155049cf5 on hv-cinder-82725 Mar 05 02:56:20.621361 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [req-112d2c7c-09d6-448b-bafe-d44446bb8b8b req-aa931457-97bd-4627-9039-af1b4c6d3f57 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055251 Mar 05 02:56:20.623117 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 263/541] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Mar 5 02:56:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 02:56:20.765589 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-d78a5e91-0b5c-4142-b718-ed0ca83a276b tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:56:20.766235 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-d78a5e91-0b5c-4142-b718-ed0ca83a276b tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] [instance: 1b31d7bf-888c-45a2-bc3a-e7077ad3a96d] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:56:20.776318 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-d78a5e91-0b5c-4142-b718-ed0ca83a276b tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:56:20.776768 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-d78a5e91-0b5c-4142-b718-ed0ca83a276b tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:56:20.777826 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-d78a5e91-0b5c-4142-b718-ed0ca83a276b tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:56:20.778341 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-d78a5e91-0b5c-4142-b718-ed0ca83a276b tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:56:21.044260 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-d78a5e91-0b5c-4142-b718-ed0ca83a276b tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:56:21.053257 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-d78a5e91-0b5c-4142-b718-ed0ca83a276b tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:56:21.055057 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-d78a5e91-0b5c-4142-b718-ed0ca83a276b tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:56:21.056435 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-d78a5e91-0b5c-4142-b718-ed0ca83a276b tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] 10.222.0.26 "GET /compute/v2.1/servers/1b31d7bf-888c-45a2-bc3a-e7077ad3a96d" status: 200 len: 1405 microversion: 2.20 time: 0.295501 Mar 05 02:56:21.056998 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 279/542] 10.222.0.26 () {60 vars in 1276 bytes} [Sat Mar 5 02:56:20 2022] GET /compute/v2.1/servers/1b31d7bf-888c-45a2-bc3a-e7077ad3a96d => generated 1405 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 02:56:21.476682 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-579859c3-1b78-4c38-b5de-547a3ce38217 tempest-VolumesSnapshotTestJSON-729970751 tempest-VolumesSnapshotTestJSON-729970751-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:56:21.477485 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-579859c3-1b78-4c38-b5de-547a3ce38217 tempest-VolumesSnapshotTestJSON-729970751 tempest-VolumesSnapshotTestJSON-729970751-project] [instance: 110e5aaf-5b65-47ec-8a04-b48155049cf5] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:56:21.486176 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-579859c3-1b78-4c38-b5de-547a3ce38217 tempest-VolumesSnapshotTestJSON-729970751 tempest-VolumesSnapshotTestJSON-729970751-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:56:21.486707 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-579859c3-1b78-4c38-b5de-547a3ce38217 tempest-VolumesSnapshotTestJSON-729970751 tempest-VolumesSnapshotTestJSON-729970751-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:56:21.487567 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-579859c3-1b78-4c38-b5de-547a3ce38217 tempest-VolumesSnapshotTestJSON-729970751 tempest-VolumesSnapshotTestJSON-729970751-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:56:21.488085 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-579859c3-1b78-4c38-b5de-547a3ce38217 tempest-VolumesSnapshotTestJSON-729970751 tempest-VolumesSnapshotTestJSON-729970751-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:56:21.503188 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.wsgi [None req-579859c3-1b78-4c38-b5de-547a3ce38217 tempest-VolumesSnapshotTestJSON-729970751 tempest-VolumesSnapshotTestJSON-729970751-project] HTTP exception thrown: Instance 110e5aaf-5b65-47ec-8a04-b48155049cf5 could not be found. Mar 05 02:56:21.503889 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-579859c3-1b78-4c38-b5de-547a3ce38217 tempest-VolumesSnapshotTestJSON-729970751 tempest-VolumesSnapshotTestJSON-729970751-project] Returning 404 to user: Instance 110e5aaf-5b65-47ec-8a04-b48155049cf5 could not be found. {{(pid=123546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 02:56:21.504805 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-579859c3-1b78-4c38-b5de-547a3ce38217 tempest-VolumesSnapshotTestJSON-729970751 tempest-VolumesSnapshotTestJSON-729970751-project] 10.222.0.26 "GET /compute/v2.1/servers/110e5aaf-5b65-47ec-8a04-b48155049cf5" status: 404 len: 111 microversion: 2.1 time: 0.032415 Mar 05 02:56:21.508499 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 264/543] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:56:21 2022] GET /compute/v2.1/servers/110e5aaf-5b65-47ec-8a04-b48155049cf5 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 05 02:56:22.076450 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-aa04301b-a122-4183-b800-df21e7ddd531 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:56:22.077550 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-aa04301b-a122-4183-b800-df21e7ddd531 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] [instance: 1b31d7bf-888c-45a2-bc3a-e7077ad3a96d] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:56:22.085943 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-aa04301b-a122-4183-b800-df21e7ddd531 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:56:22.086424 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-aa04301b-a122-4183-b800-df21e7ddd531 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:56:22.087199 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-aa04301b-a122-4183-b800-df21e7ddd531 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:56:22.087631 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-aa04301b-a122-4183-b800-df21e7ddd531 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:56:22.236997 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-aa04301b-a122-4183-b800-df21e7ddd531 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:56:22.246041 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-aa04301b-a122-4183-b800-df21e7ddd531 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:56:22.249338 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-aa04301b-a122-4183-b800-df21e7ddd531 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:56:22.250476 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-aa04301b-a122-4183-b800-df21e7ddd531 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] 10.222.0.26 "GET /compute/v2.1/servers/1b31d7bf-888c-45a2-bc3a-e7077ad3a96d" status: 200 len: 1405 microversion: 2.20 time: 0.178507 Mar 05 02:56:22.251032 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 280/544] 10.222.0.26 () {60 vars in 1276 bytes} [Sat Mar 5 02:56:22 2022] GET /compute/v2.1/servers/1b31d7bf-888c-45a2-bc3a-e7077ad3a96d => generated 1405 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 02:56:22.643370 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [req-f64bc078-3ae5-4996-8a47-6e09b7d0b00e req-71ecdfcd-7e98-4cfc-aa97-b4efc7dfa37a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1b31d7bf-888c-45a2-bc3a-e7077ad3a96d", "tag": "72f8e9b7-28cd-4b80-be32-d7f04625063d"}]} {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 02:56:22.653501 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [req-f64bc078-3ae5-4996-8a47-6e09b7d0b00e req-71ecdfcd-7e98-4cfc-aa97-b4efc7dfa37a service nova] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:56:22.653940 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [req-f64bc078-3ae5-4996-8a47-6e09b7d0b00e req-71ecdfcd-7e98-4cfc-aa97-b4efc7dfa37a service nova] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:56:22.669581 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.compute.server_external_events [req-f64bc078-3ae5-4996-8a47-6e09b7d0b00e req-71ecdfcd-7e98-4cfc-aa97-b4efc7dfa37a service nova] Creating event network-changed:72f8e9b7-28cd-4b80-be32-d7f04625063d for instance 1b31d7bf-888c-45a2-bc3a-e7077ad3a96d on hv-cinder-82725 Mar 05 02:56:22.676480 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [req-f64bc078-3ae5-4996-8a47-6e09b7d0b00e req-71ecdfcd-7e98-4cfc-aa97-b4efc7dfa37a service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036414 Mar 05 02:56:22.677095 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 265/545] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Mar 5 02:56:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 02:56:23.268962 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-1180c288-42f8-4dcf-9683-f17d135a5e24 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:56:23.269570 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-1180c288-42f8-4dcf-9683-f17d135a5e24 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] [instance: 1b31d7bf-888c-45a2-bc3a-e7077ad3a96d] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:56:23.276187 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-1180c288-42f8-4dcf-9683-f17d135a5e24 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:56:23.276678 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-1180c288-42f8-4dcf-9683-f17d135a5e24 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:56:23.277488 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-1180c288-42f8-4dcf-9683-f17d135a5e24 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:56:23.277974 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-1180c288-42f8-4dcf-9683-f17d135a5e24 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:56:23.412349 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-1180c288-42f8-4dcf-9683-f17d135a5e24 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:56:23.419990 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-1180c288-42f8-4dcf-9683-f17d135a5e24 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:56:23.422192 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-1180c288-42f8-4dcf-9683-f17d135a5e24 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:56:23.423308 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-1180c288-42f8-4dcf-9683-f17d135a5e24 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] 10.222.0.26 "GET /compute/v2.1/servers/1b31d7bf-888c-45a2-bc3a-e7077ad3a96d" status: 200 len: 1405 microversion: 2.20 time: 0.158463 Mar 05 02:56:23.423904 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 281/546] 10.222.0.26 () {60 vars in 1276 bytes} [Sat Mar 5 02:56:23 2022] GET /compute/v2.1/servers/1b31d7bf-888c-45a2-bc3a-e7077ad3a96d => generated 1405 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 02:56:24.442850 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-5d27a969-2fd3-4f54-87c6-b715c65ed915 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:56:24.443538 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-5d27a969-2fd3-4f54-87c6-b715c65ed915 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] [instance: 1b31d7bf-888c-45a2-bc3a-e7077ad3a96d] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:56:24.449677 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-5d27a969-2fd3-4f54-87c6-b715c65ed915 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:56:24.450153 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-5d27a969-2fd3-4f54-87c6-b715c65ed915 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:56:24.450910 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-5d27a969-2fd3-4f54-87c6-b715c65ed915 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:56:24.451340 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-5d27a969-2fd3-4f54-87c6-b715c65ed915 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:56:24.581189 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-5d27a969-2fd3-4f54-87c6-b715c65ed915 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:56:24.589023 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-5d27a969-2fd3-4f54-87c6-b715c65ed915 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:56:24.590573 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-5d27a969-2fd3-4f54-87c6-b715c65ed915 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:56:24.591665 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-5d27a969-2fd3-4f54-87c6-b715c65ed915 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] 10.222.0.26 "GET /compute/v2.1/servers/1b31d7bf-888c-45a2-bc3a-e7077ad3a96d" status: 200 len: 1405 microversion: 2.20 time: 0.153592 Mar 05 02:56:24.592221 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 266/547] 10.222.0.26 () {60 vars in 1276 bytes} [Sat Mar 5 02:56:24 2022] GET /compute/v2.1/servers/1b31d7bf-888c-45a2-bc3a-e7077ad3a96d => generated 1405 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 02:56:25.610493 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-ece8db21-3ff6-4043-93c4-0964b04e13dd tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:56:25.611094 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-ece8db21-3ff6-4043-93c4-0964b04e13dd tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] [instance: 1b31d7bf-888c-45a2-bc3a-e7077ad3a96d] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:56:25.617381 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-ece8db21-3ff6-4043-93c4-0964b04e13dd tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:56:25.617831 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-ece8db21-3ff6-4043-93c4-0964b04e13dd tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:56:25.618627 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-ece8db21-3ff6-4043-93c4-0964b04e13dd tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:56:25.619063 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-ece8db21-3ff6-4043-93c4-0964b04e13dd tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:56:25.756548 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-ece8db21-3ff6-4043-93c4-0964b04e13dd tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:56:25.764271 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-ece8db21-3ff6-4043-93c4-0964b04e13dd tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:56:25.765798 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-ece8db21-3ff6-4043-93c4-0964b04e13dd tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:56:25.766917 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-ece8db21-3ff6-4043-93c4-0964b04e13dd tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] 10.222.0.26 "GET /compute/v2.1/servers/1b31d7bf-888c-45a2-bc3a-e7077ad3a96d" status: 200 len: 1405 microversion: 2.20 time: 0.160844 Mar 05 02:56:25.767483 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 282/548] 10.222.0.26 () {60 vars in 1276 bytes} [Sat Mar 5 02:56:25 2022] GET /compute/v2.1/servers/1b31d7bf-888c-45a2-bc3a-e7077ad3a96d => generated 1405 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 02:56:26.784828 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-9178283f-8b1c-4783-9fa6-6eb309af53d3 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:56:26.785437 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-9178283f-8b1c-4783-9fa6-6eb309af53d3 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] [instance: 1b31d7bf-888c-45a2-bc3a-e7077ad3a96d] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:56:26.792332 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-9178283f-8b1c-4783-9fa6-6eb309af53d3 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:56:26.792763 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-9178283f-8b1c-4783-9fa6-6eb309af53d3 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:56:26.793541 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-9178283f-8b1c-4783-9fa6-6eb309af53d3 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:56:26.794103 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-9178283f-8b1c-4783-9fa6-6eb309af53d3 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:56:26.925886 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-9178283f-8b1c-4783-9fa6-6eb309af53d3 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:56:26.933618 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-9178283f-8b1c-4783-9fa6-6eb309af53d3 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:56:26.935115 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-9178283f-8b1c-4783-9fa6-6eb309af53d3 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:56:26.936203 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-9178283f-8b1c-4783-9fa6-6eb309af53d3 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] 10.222.0.26 "GET /compute/v2.1/servers/1b31d7bf-888c-45a2-bc3a-e7077ad3a96d" status: 200 len: 1405 microversion: 2.20 time: 0.155326 Mar 05 02:56:26.937518 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 267/549] 10.222.0.26 () {60 vars in 1276 bytes} [Sat Mar 5 02:56:26 2022] GET /compute/v2.1/servers/1b31d7bf-888c-45a2-bc3a-e7077ad3a96d => generated 1405 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 02:56:27.955497 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-2a7198b1-dc7e-4536-abad-44b047d0fe38 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:56:27.956025 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-2a7198b1-dc7e-4536-abad-44b047d0fe38 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] [instance: 1b31d7bf-888c-45a2-bc3a-e7077ad3a96d] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:56:27.962922 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-2a7198b1-dc7e-4536-abad-44b047d0fe38 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:56:27.963377 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-2a7198b1-dc7e-4536-abad-44b047d0fe38 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:56:27.964299 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-2a7198b1-dc7e-4536-abad-44b047d0fe38 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:56:27.964927 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-2a7198b1-dc7e-4536-abad-44b047d0fe38 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:56:28.099159 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-2a7198b1-dc7e-4536-abad-44b047d0fe38 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:56:28.107987 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-2a7198b1-dc7e-4536-abad-44b047d0fe38 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:56:28.109766 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-2a7198b1-dc7e-4536-abad-44b047d0fe38 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:56:28.110924 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-2a7198b1-dc7e-4536-abad-44b047d0fe38 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] 10.222.0.26 "GET /compute/v2.1/servers/1b31d7bf-888c-45a2-bc3a-e7077ad3a96d" status: 200 len: 1405 microversion: 2.20 time: 0.160097 Mar 05 02:56:28.121045 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 283/550] 10.222.0.26 () {60 vars in 1276 bytes} [Sat Mar 5 02:56:27 2022] GET /compute/v2.1/servers/1b31d7bf-888c-45a2-bc3a-e7077ad3a96d => generated 1405 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 02:56:28.335399 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [req-a868fab5-081d-48f0-a359-5aa5a68a88ee req-a024fe63-bf26-4e99-9884-b0c47d85ac83 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b31d7bf-888c-45a2-bc3a-e7077ad3a96d", "name": "network-vif-plugged", "status": "completed", "tag": "72f8e9b7-28cd-4b80-be32-d7f04625063d"}]} {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 02:56:28.343961 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [req-a868fab5-081d-48f0-a359-5aa5a68a88ee req-a024fe63-bf26-4e99-9884-b0c47d85ac83 service nova] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:56:28.344412 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [req-a868fab5-081d-48f0-a359-5aa5a68a88ee req-a024fe63-bf26-4e99-9884-b0c47d85ac83 service nova] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:56:28.356043 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.compute.server_external_events [req-a868fab5-081d-48f0-a359-5aa5a68a88ee req-a024fe63-bf26-4e99-9884-b0c47d85ac83 service nova] Creating event network-vif-plugged:72f8e9b7-28cd-4b80-be32-d7f04625063d for instance 1b31d7bf-888c-45a2-bc3a-e7077ad3a96d on hv-cinder-82725 Mar 05 02:56:28.361121 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [req-a868fab5-081d-48f0-a359-5aa5a68a88ee req-a024fe63-bf26-4e99-9884-b0c47d85ac83 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029499 Mar 05 02:56:28.361716 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 268/551] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Mar 5 02:56:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 05 02:56:29.128672 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-40375aee-adcb-4a20-b448-1c40a8d0fa6b tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:56:29.129659 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-40375aee-adcb-4a20-b448-1c40a8d0fa6b tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] [instance: 1b31d7bf-888c-45a2-bc3a-e7077ad3a96d] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:56:29.136379 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-40375aee-adcb-4a20-b448-1c40a8d0fa6b tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:56:29.136874 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-40375aee-adcb-4a20-b448-1c40a8d0fa6b tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:56:29.137636 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-40375aee-adcb-4a20-b448-1c40a8d0fa6b tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:56:29.138102 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-40375aee-adcb-4a20-b448-1c40a8d0fa6b tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:56:29.267657 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-40375aee-adcb-4a20-b448-1c40a8d0fa6b tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:56:29.275328 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-40375aee-adcb-4a20-b448-1c40a8d0fa6b tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:56:29.276813 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-40375aee-adcb-4a20-b448-1c40a8d0fa6b tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:56:29.277907 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-40375aee-adcb-4a20-b448-1c40a8d0fa6b tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] 10.222.0.26 "GET /compute/v2.1/servers/1b31d7bf-888c-45a2-bc3a-e7077ad3a96d" status: 200 len: 1405 microversion: 2.20 time: 0.153225 Mar 05 02:56:29.278663 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 284/552] 10.222.0.26 () {60 vars in 1276 bytes} [Sat Mar 5 02:56:29 2022] GET /compute/v2.1/servers/1b31d7bf-888c-45a2-bc3a-e7077ad3a96d => generated 1405 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 02:56:30.297560 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-4bfbe41f-5cc2-4616-9e44-bbe090fa742d tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:56:30.298206 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-4bfbe41f-5cc2-4616-9e44-bbe090fa742d tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] [instance: 1b31d7bf-888c-45a2-bc3a-e7077ad3a96d] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:56:30.304719 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-4bfbe41f-5cc2-4616-9e44-bbe090fa742d tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:56:30.305166 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-4bfbe41f-5cc2-4616-9e44-bbe090fa742d tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:56:30.305933 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-4bfbe41f-5cc2-4616-9e44-bbe090fa742d tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:56:30.306387 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-4bfbe41f-5cc2-4616-9e44-bbe090fa742d tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:56:30.441232 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-4bfbe41f-5cc2-4616-9e44-bbe090fa742d tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:56:30.448833 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-4bfbe41f-5cc2-4616-9e44-bbe090fa742d tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:56:30.450342 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-4bfbe41f-5cc2-4616-9e44-bbe090fa742d tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:56:30.451617 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-4bfbe41f-5cc2-4616-9e44-bbe090fa742d tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] 10.222.0.26 "GET /compute/v2.1/servers/1b31d7bf-888c-45a2-bc3a-e7077ad3a96d" status: 200 len: 1597 microversion: 2.20 time: 0.158854 Mar 05 02:56:30.452225 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 269/553] 10.222.0.26 () {60 vars in 1276 bytes} [Sat Mar 5 02:56:30 2022] GET /compute/v2.1/servers/1b31d7bf-888c-45a2-bc3a-e7077ad3a96d => generated 1597 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 02:56:30.470300 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-8030cbdd-5d19-482c-bb77-db71913e83e3 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:56:30.470825 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-8030cbdd-5d19-482c-bb77-db71913e83e3 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] [instance: 1b31d7bf-888c-45a2-bc3a-e7077ad3a96d] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:56:30.476708 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-8030cbdd-5d19-482c-bb77-db71913e83e3 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:56:30.477157 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-8030cbdd-5d19-482c-bb77-db71913e83e3 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:56:30.477921 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-8030cbdd-5d19-482c-bb77-db71913e83e3 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:56:30.478649 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-8030cbdd-5d19-482c-bb77-db71913e83e3 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:56:30.558581 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-8030cbdd-5d19-482c-bb77-db71913e83e3 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] 10.222.0.26 "GET /compute/v2.1/servers/1b31d7bf-888c-45a2-bc3a-e7077ad3a96d/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.093498 Mar 05 02:56:30.559186 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 285/554] 10.222.0.26 () {60 vars in 1315 bytes} [Sat Mar 5 02:56:30 2022] GET /compute/v2.1/servers/1b31d7bf-888c-45a2-bc3a-e7077ad3a96d/os-interface => generated 284 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 05 02:56:31.502907 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [req-a61da2ba-9446-43a9-871a-1b35c7d817f8 req-79017f7f-696a-49b9-88ea-a7bea15ee597 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1b31d7bf-888c-45a2-bc3a-e7077ad3a96d", "tag": "72f8e9b7-28cd-4b80-be32-d7f04625063d"}]} {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 02:56:31.511226 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [req-a61da2ba-9446-43a9-871a-1b35c7d817f8 req-79017f7f-696a-49b9-88ea-a7bea15ee597 service nova] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:56:31.511669 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [req-a61da2ba-9446-43a9-871a-1b35c7d817f8 req-79017f7f-696a-49b9-88ea-a7bea15ee597 service nova] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:56:31.523321 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.compute.server_external_events [req-a61da2ba-9446-43a9-871a-1b35c7d817f8 req-79017f7f-696a-49b9-88ea-a7bea15ee597 service nova] Creating event network-changed:72f8e9b7-28cd-4b80-be32-d7f04625063d for instance 1b31d7bf-888c-45a2-bc3a-e7077ad3a96d on hv-cinder-82725 Mar 05 02:56:31.528132 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [req-a61da2ba-9446-43a9-871a-1b35c7d817f8 req-79017f7f-696a-49b9-88ea-a7bea15ee597 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029712 Mar 05 02:56:31.528940 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 270/555] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Mar 5 02:56:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 02:56:52.020315 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-80355bb5-0fcd-44b4-8ccf-1221b21e563e tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:56:52.020887 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-80355bb5-0fcd-44b4-8ccf-1221b21e563e tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] [instance: ec6e78b4-5147-4f9b-84ce-c5d5ec0bd30d] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:56:52.026644 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-80355bb5-0fcd-44b4-8ccf-1221b21e563e tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:56:52.027080 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-80355bb5-0fcd-44b4-8ccf-1221b21e563e tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:56:52.027845 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-80355bb5-0fcd-44b4-8ccf-1221b21e563e tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:56:52.028279 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-80355bb5-0fcd-44b4-8ccf-1221b21e563e tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:56:52.052619 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-80355bb5-0fcd-44b4-8ccf-1221b21e563e tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] 10.222.0.26 "GET /compute/v2.1/servers/ec6e78b4-5147-4f9b-84ce-c5d5ec0bd30d/ips" status: 200 len: 149 microversion: 2.1 time: 0.037424 Mar 05 02:56:52.053194 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 286/556] 10.222.0.26 () {58 vars in 1247 bytes} [Sat Mar 5 02:56:52 2022] GET /compute/v2.1/servers/ec6e78b4-5147-4f9b-84ce-c5d5ec0bd30d/ips => generated 149 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 02:56:53.379780 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-cae66890-c1ff-4b44-8154-944a00ed3f2d tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0f93f6b2-9d01-4384-b524-bd602fd0bd41"}} {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 02:56:53.380920 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-cae66890-c1ff-4b44-8154-944a00ed3f2d tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] [instance: ec6e78b4-5147-4f9b-84ce-c5d5ec0bd30d] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:56:53.386908 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-cae66890-c1ff-4b44-8154-944a00ed3f2d tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:56:53.387353 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-cae66890-c1ff-4b44-8154-944a00ed3f2d tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:56:53.388105 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-cae66890-c1ff-4b44-8154-944a00ed3f2d tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:56:53.388535 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-cae66890-c1ff-4b44-8154-944a00ed3f2d tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:56:55.872904 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-cae66890-c1ff-4b44-8154-944a00ed3f2d tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] 10.222.0.26 "POST /compute/v2.1/servers/ec6e78b4-5147-4f9b-84ce-c5d5ec0bd30d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.497311 Mar 05 02:56:55.873537 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 271/557] 10.222.0.26 () {60 vars in 1322 bytes} [Sat Mar 5 02:56:53 2022] POST /compute/v2.1/servers/ec6e78b4-5147-4f9b-84ce-c5d5ec0bd30d/os-volume_attachments => generated 194 bytes in 2499 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 02:57:02.292326 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-6cef9f40-a76e-471c-95e9-c6d4ba149cac tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Action: 'create', calling method: .version_select at 0x7f3f61d72280>, body: {"keypair": {"name": "tempest-keypair-2107035222"}} {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 02:57:02.306135 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.quota [None req-6cef9f40-a76e-471c-95e9-c6d4ba149cac tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Getting quotas for project 3dd2b27540c04b4c8741ce8c9a5e2b47. Resources: {'key_pairs'} {{(pid=123545) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 02:57:02.309775 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.quota [None req-6cef9f40-a76e-471c-95e9-c6d4ba149cac tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Getting quotas for user af8fb7f45f4d4eb180ccaca3d52ed2dc and project 3dd2b27540c04b4c8741ce8c9a5e2b47. Resources: {'key_pairs'} {{(pid=123545) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 02:57:02.535245 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.quota [None req-6cef9f40-a76e-471c-95e9-c6d4ba149cac tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Getting quotas for project 3dd2b27540c04b4c8741ce8c9a5e2b47. Resources: {'key_pairs'} {{(pid=123545) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 02:57:02.538833 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.quota [None req-6cef9f40-a76e-471c-95e9-c6d4ba149cac tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Getting quotas for user af8fb7f45f4d4eb180ccaca3d52ed2dc and project 3dd2b27540c04b4c8741ce8c9a5e2b47. Resources: {'key_pairs'} {{(pid=123545) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 02:57:02.551202 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-6cef9f40-a76e-471c-95e9-c6d4ba149cac tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 2305 microversion: 2.1 time: 0.262658 Mar 05 02:57:02.551791 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 287/558] 10.222.0.26 () {60 vars in 1157 bytes} [Sat Mar 5 02:57:02 2022] POST /compute/v2.1/os-keypairs => generated 2305 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 02:57:03.780861 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-5a2717c4-a6fe-4130-af94-1a735e7e6fef tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-210969629", "imageRef": "adbc7df1-116e-4f9f-a28d-a6a3c084cceb", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ea79f853-47ea-48eb-b063-dca7ecd22a4d"}], "security_groups": [{"name": "tempest-securitygroup--998331533"}], "key_name": "tempest-keypair-2107035222", "user_data": "}} {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 02:57:04.058519 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.network.neutron [None req-5a2717c4-a6fe-4130-af94-1a735e7e6fef tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] validate_networks() for [('ea79f853-47ea-48eb-b063-dca7ecd22a4d', None, None, None, None, None)] {{(pid=123546) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 05 02:57:04.413920 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.virt.hardware [None req-5a2717c4-a6fe-4130-af94-1a735e7e6fef tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Flavor limits 0:0:0 {{(pid=123546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 05 02:57:04.414376 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.virt.hardware [None req-5a2717c4-a6fe-4130-af94-1a735e7e6fef tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Image limits 0:0:0 {{(pid=123546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 05 02:57:04.414855 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.virt.hardware [None req-5a2717c4-a6fe-4130-af94-1a735e7e6fef tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Flavor pref 0:0:0 {{(pid=123546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 05 02:57:04.415256 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.virt.hardware [None req-5a2717c4-a6fe-4130-af94-1a735e7e6fef tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Image pref 0:0:0 {{(pid=123546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 05 02:57:04.415668 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.virt.hardware [None req-5a2717c4-a6fe-4130-af94-1a735e7e6fef tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 05 02:57:04.425143 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-5a2717c4-a6fe-4130-af94-1a735e7e6fef tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:57:04.425597 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-5a2717c4-a6fe-4130-af94-1a735e7e6fef tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:57:04.426449 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-5a2717c4-a6fe-4130-af94-1a735e7e6fef tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:57:04.426895 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-5a2717c4-a6fe-4130-af94-1a735e7e6fef tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:57:04.444530 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.quota [None req-5a2717c4-a6fe-4130-af94-1a735e7e6fef tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Getting quotas for project 3dd2b27540c04b4c8741ce8c9a5e2b47. Resources: {'ram', 'cores', 'instances'} {{(pid=123546) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 02:57:04.448526 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.quota [None req-5a2717c4-a6fe-4130-af94-1a735e7e6fef tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Getting quotas for user af8fb7f45f4d4eb180ccaca3d52ed2dc and project 3dd2b27540c04b4c8741ce8c9a5e2b47. Resources: {'ram', 'cores', 'instances'} {{(pid=123546) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 02:57:04.459915 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-5a2717c4-a6fe-4130-af94-1a735e7e6fef tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Going to run 1 instances... {{(pid=123546) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 05 02:57:04.462377 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-5a2717c4-a6fe-4130-af94-1a735e7e6fef tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] [instance: cd7bf2d1-7563-4057-8f9b-b7e51d741a6c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='adbc7df1-116e-4f9f-a28d-a6a3c084cceb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123546) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 05 02:57:04.510282 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-5a2717c4-a6fe-4130-af94-1a735e7e6fef tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.734416 Mar 05 02:57:04.510949 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 272/559] 10.222.0.26 () {60 vars in 1146 bytes} [Sat Mar 5 02:57:03 2022] POST /compute/v2.1/servers => generated 401 bytes in 736 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Mar 05 02:57:04.520933 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-1806de76-85ca-4fce-83bb-c42a17b91e18 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:57:04.521674 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-1806de76-85ca-4fce-83bb-c42a17b91e18 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] [instance: cd7bf2d1-7563-4057-8f9b-b7e51d741a6c] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:57:04.682886 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-1806de76-85ca-4fce-83bb-c42a17b91e18 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af8fb7f45f4d4eb180ccaca3d52ed2dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dd2b27540c04b4c8741ce8c9a5e2b47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:57:04.689986 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-1806de76-85ca-4fce-83bb-c42a17b91e18 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] 10.222.0.26 "GET /compute/v2.1/servers/cd7bf2d1-7563-4057-8f9b-b7e51d741a6c" status: 200 len: 1241 microversion: 2.1 time: 0.172252 Mar 05 02:57:04.690557 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 288/560] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:57:04 2022] GET /compute/v2.1/servers/cd7bf2d1-7563-4057-8f9b-b7e51d741a6c => generated 1241 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 02:57:05.025536 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-f07131cb-aad5-4f61-8f76-58b7192d04bc tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:57:05.026524 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-f07131cb-aad5-4f61-8f76-58b7192d04bc tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] [instance: d0080e4b-6532-4e0c-8d19-cfbdf32e401b] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:57:05.034468 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-f07131cb-aad5-4f61-8f76-58b7192d04bc tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:57:05.035032 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-f07131cb-aad5-4f61-8f76-58b7192d04bc tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:57:05.035931 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-f07131cb-aad5-4f61-8f76-58b7192d04bc tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:57:05.036385 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-f07131cb-aad5-4f61-8f76-58b7192d04bc tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:57:05.065078 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-f07131cb-aad5-4f61-8f76-58b7192d04bc tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] 10.222.0.26 "GET /compute/v2.1/servers/d0080e4b-6532-4e0c-8d19-cfbdf32e401b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044364 Mar 05 02:57:05.065650 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 273/561] 10.222.0.26 () {58 vars in 1301 bytes} [Sat Mar 5 02:57:05 2022] GET /compute/v2.1/servers/d0080e4b-6532-4e0c-8d19-cfbdf32e401b/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 05 02:57:05.124854 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-9726038f-9ed4-4e9c-a63e-c7cb1b2ad6bc tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:57:05.125351 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-9726038f-9ed4-4e9c-a63e-c7cb1b2ad6bc tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] [instance: d0080e4b-6532-4e0c-8d19-cfbdf32e401b] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:57:05.131905 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-9726038f-9ed4-4e9c-a63e-c7cb1b2ad6bc tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:57:05.132352 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-9726038f-9ed4-4e9c-a63e-c7cb1b2ad6bc tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:57:05.133116 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-9726038f-9ed4-4e9c-a63e-c7cb1b2ad6bc tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:57:05.133579 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-9726038f-9ed4-4e9c-a63e-c7cb1b2ad6bc tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:57:05.156400 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-9726038f-9ed4-4e9c-a63e-c7cb1b2ad6bc tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] [instance: d0080e4b-6532-4e0c-8d19-cfbdf32e401b] Going to try to terminate instance {{(pid=123545) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 05 02:57:05.228983 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-9726038f-9ed4-4e9c-a63e-c7cb1b2ad6bc tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] 10.222.0.26 "DELETE /compute/v2.1/servers/d0080e4b-6532-4e0c-8d19-cfbdf32e401b" status: 204 len: 0 microversion: 2.1 time: 0.107243 Mar 05 02:57:05.229532 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 289/562] 10.222.0.26 () {58 vars in 1238 bytes} [Sat Mar 5 02:57:05 2022] DELETE /compute/v2.1/servers/d0080e4b-6532-4e0c-8d19-cfbdf32e401b => generated 0 bytes in 109 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 05 02:57:05.238285 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-0a0ee156-f619-456d-a504-66b8f499352f tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:57:05.238915 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-0a0ee156-f619-456d-a504-66b8f499352f tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] [instance: d0080e4b-6532-4e0c-8d19-cfbdf32e401b] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:57:05.244789 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-0a0ee156-f619-456d-a504-66b8f499352f tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:57:05.245238 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-0a0ee156-f619-456d-a504-66b8f499352f tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:57:05.246021 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-0a0ee156-f619-456d-a504-66b8f499352f tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:57:05.246466 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-0a0ee156-f619-456d-a504-66b8f499352f tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:57:05.379029 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-0a0ee156-f619-456d-a504-66b8f499352f tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e5a000087fe40419ccd0d1a96fb4783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9d27da2e71d4962a53a95efc46518ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:57:05.386330 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-0a0ee156-f619-456d-a504-66b8f499352f tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] 10.222.0.26 "GET /compute/v2.1/servers/d0080e4b-6532-4e0c-8d19-cfbdf32e401b" status: 200 len: 1674 microversion: 2.1 time: 0.152235 Mar 05 02:57:05.387067 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 274/563] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:57:05 2022] GET /compute/v2.1/servers/d0080e4b-6532-4e0c-8d19-cfbdf32e401b => generated 1674 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 02:57:05.707507 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-e5b079e7-b18c-46d0-9933-a7913d659c0b tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:57:05.708200 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-e5b079e7-b18c-46d0-9933-a7913d659c0b tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] [instance: cd7bf2d1-7563-4057-8f9b-b7e51d741a6c] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:57:05.714421 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-e5b079e7-b18c-46d0-9933-a7913d659c0b tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:57:05.714867 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-e5b079e7-b18c-46d0-9933-a7913d659c0b tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:57:05.715632 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-e5b079e7-b18c-46d0-9933-a7913d659c0b tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:57:05.716059 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-e5b079e7-b18c-46d0-9933-a7913d659c0b tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:57:05.784428 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-e5b079e7-b18c-46d0-9933-a7913d659c0b tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af8fb7f45f4d4eb180ccaca3d52ed2dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dd2b27540c04b4c8741ce8c9a5e2b47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:57:05.791659 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-e5b079e7-b18c-46d0-9933-a7913d659c0b tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] 10.222.0.26 "GET /compute/v2.1/servers/cd7bf2d1-7563-4057-8f9b-b7e51d741a6c" status: 200 len: 1299 microversion: 2.1 time: 0.088344 Mar 05 02:57:05.792402 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 290/564] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:57:05 2022] GET /compute/v2.1/servers/cd7bf2d1-7563-4057-8f9b-b7e51d741a6c => generated 1299 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 02:57:06.403896 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-538157fa-c72c-4170-a572-42913b3f76b3 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:57:06.404627 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-538157fa-c72c-4170-a572-42913b3f76b3 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] [instance: d0080e4b-6532-4e0c-8d19-cfbdf32e401b] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:57:06.412659 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-538157fa-c72c-4170-a572-42913b3f76b3 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:57:06.413110 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-538157fa-c72c-4170-a572-42913b3f76b3 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:57:06.413886 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-538157fa-c72c-4170-a572-42913b3f76b3 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:57:06.417662 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-538157fa-c72c-4170-a572-42913b3f76b3 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:57:06.695711 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-538157fa-c72c-4170-a572-42913b3f76b3 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e5a000087fe40419ccd0d1a96fb4783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9d27da2e71d4962a53a95efc46518ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:57:06.702926 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-538157fa-c72c-4170-a572-42913b3f76b3 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] 10.222.0.26 "GET /compute/v2.1/servers/d0080e4b-6532-4e0c-8d19-cfbdf32e401b" status: 200 len: 1674 microversion: 2.1 time: 0.302975 Mar 05 02:57:06.708353 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 275/565] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:57:06 2022] GET /compute/v2.1/servers/d0080e4b-6532-4e0c-8d19-cfbdf32e401b => generated 1674 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 02:57:06.810448 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-96f884dd-8b18-4e64-a586-897c754c5730 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:57:06.811062 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-96f884dd-8b18-4e64-a586-897c754c5730 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] [instance: cd7bf2d1-7563-4057-8f9b-b7e51d741a6c] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:57:06.817734 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-96f884dd-8b18-4e64-a586-897c754c5730 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:57:06.818221 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-96f884dd-8b18-4e64-a586-897c754c5730 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:57:06.818989 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-96f884dd-8b18-4e64-a586-897c754c5730 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:57:06.819425 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-96f884dd-8b18-4e64-a586-897c754c5730 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:57:07.057442 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-96f884dd-8b18-4e64-a586-897c754c5730 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af8fb7f45f4d4eb180ccaca3d52ed2dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dd2b27540c04b4c8741ce8c9a5e2b47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:57:07.074322 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-96f884dd-8b18-4e64-a586-897c754c5730 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] 10.222.0.26 "GET /compute/v2.1/servers/cd7bf2d1-7563-4057-8f9b-b7e51d741a6c" status: 200 len: 1366 microversion: 2.1 time: 0.267687 Mar 05 02:57:07.075111 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 291/566] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:57:06 2022] GET /compute/v2.1/servers/cd7bf2d1-7563-4057-8f9b-b7e51d741a6c => generated 1366 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 02:57:07.141919 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [req-9d03d980-8626-493b-8d08-8c1a14f1df7b req-4a0d28d5-ee8c-4c7d-8f81-d25b1a033e07 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cd7bf2d1-7563-4057-8f9b-b7e51d741a6c", "tag": "e30d5b85-41e6-47b6-930e-a7a045a9d2fb"}]} {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 02:57:07.155260 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [req-9d03d980-8626-493b-8d08-8c1a14f1df7b req-4a0d28d5-ee8c-4c7d-8f81-d25b1a033e07 service nova] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:57:07.155716 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [req-9d03d980-8626-493b-8d08-8c1a14f1df7b req-4a0d28d5-ee8c-4c7d-8f81-d25b1a033e07 service nova] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:57:07.170366 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.compute.server_external_events [req-9d03d980-8626-493b-8d08-8c1a14f1df7b req-4a0d28d5-ee8c-4c7d-8f81-d25b1a033e07 service nova] Creating event network-changed:e30d5b85-41e6-47b6-930e-a7a045a9d2fb for instance cd7bf2d1-7563-4057-8f9b-b7e51d741a6c on hv-cinder-82725 Mar 05 02:57:07.175902 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [req-9d03d980-8626-493b-8d08-8c1a14f1df7b req-4a0d28d5-ee8c-4c7d-8f81-d25b1a033e07 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037658 Mar 05 02:57:07.176520 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 276/567] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Mar 5 02:57:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 02:57:07.550125 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-d267d73a-d27e-4e96-9e62-c7795ce16bbd tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:57:07.551283 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-d267d73a-d27e-4e96-9e62-c7795ce16bbd tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] [instance: 1b31d7bf-888c-45a2-bc3a-e7077ad3a96d] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:57:07.557063 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-d267d73a-d27e-4e96-9e62-c7795ce16bbd tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:57:07.557517 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-d267d73a-d27e-4e96-9e62-c7795ce16bbd tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:57:07.558332 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-d267d73a-d27e-4e96-9e62-c7795ce16bbd tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:57:07.558773 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-d267d73a-d27e-4e96-9e62-c7795ce16bbd tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:57:07.582247 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-d267d73a-d27e-4e96-9e62-c7795ce16bbd tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] 10.222.0.26 "GET /compute/v2.1/servers/1b31d7bf-888c-45a2-bc3a-e7077ad3a96d/ips" status: 200 len: 151 microversion: 2.20 time: 0.036093 Mar 05 02:57:07.582829 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 292/568] 10.222.0.26 () {60 vars in 1288 bytes} [Sat Mar 5 02:57:07 2022] GET /compute/v2.1/servers/1b31d7bf-888c-45a2-bc3a-e7077ad3a96d/ips => generated 151 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 05 02:57:07.725488 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-291d84df-efc2-4974-915b-1c4d2c2773be tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:57:07.727092 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-291d84df-efc2-4974-915b-1c4d2c2773be tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] [instance: d0080e4b-6532-4e0c-8d19-cfbdf32e401b] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:57:07.734345 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-291d84df-efc2-4974-915b-1c4d2c2773be tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:57:07.735139 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-291d84df-efc2-4974-915b-1c4d2c2773be tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:57:07.737527 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-291d84df-efc2-4974-915b-1c4d2c2773be tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:57:07.738473 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-291d84df-efc2-4974-915b-1c4d2c2773be tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:57:08.043884 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-291d84df-efc2-4974-915b-1c4d2c2773be tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e5a000087fe40419ccd0d1a96fb4783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9d27da2e71d4962a53a95efc46518ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:57:08.052219 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-291d84df-efc2-4974-915b-1c4d2c2773be tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] 10.222.0.26 "GET /compute/v2.1/servers/d0080e4b-6532-4e0c-8d19-cfbdf32e401b" status: 200 len: 1674 microversion: 2.1 time: 0.335838 Mar 05 02:57:08.052791 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 277/569] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:57:07 2022] GET /compute/v2.1/servers/d0080e4b-6532-4e0c-8d19-cfbdf32e401b => generated 1674 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 02:57:08.092500 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-d0ece55a-123b-4b6f-99f0-98ab7bd755d4 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:57:08.093203 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-d0ece55a-123b-4b6f-99f0-98ab7bd755d4 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] [instance: cd7bf2d1-7563-4057-8f9b-b7e51d741a6c] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:57:08.099962 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-d0ece55a-123b-4b6f-99f0-98ab7bd755d4 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:57:08.100528 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-d0ece55a-123b-4b6f-99f0-98ab7bd755d4 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:57:08.101360 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-d0ece55a-123b-4b6f-99f0-98ab7bd755d4 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:57:08.101893 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-d0ece55a-123b-4b6f-99f0-98ab7bd755d4 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:57:08.431192 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-d0ece55a-123b-4b6f-99f0-98ab7bd755d4 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af8fb7f45f4d4eb180ccaca3d52ed2dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dd2b27540c04b4c8741ce8c9a5e2b47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:57:08.439054 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-d0ece55a-123b-4b6f-99f0-98ab7bd755d4 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] 10.222.0.26 "GET /compute/v2.1/servers/cd7bf2d1-7563-4057-8f9b-b7e51d741a6c" status: 200 len: 1366 microversion: 2.1 time: 0.350429 Mar 05 02:57:08.440019 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 293/570] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:57:08 2022] GET /compute/v2.1/servers/cd7bf2d1-7563-4057-8f9b-b7e51d741a6c => generated 1366 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 02:57:09.069497 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-1d8566aa-2435-4538-9de3-5915e4620793 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:57:09.070079 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-1d8566aa-2435-4538-9de3-5915e4620793 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] [instance: d0080e4b-6532-4e0c-8d19-cfbdf32e401b] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:57:09.076313 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-1d8566aa-2435-4538-9de3-5915e4620793 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:57:09.076761 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-1d8566aa-2435-4538-9de3-5915e4620793 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:57:09.077527 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-1d8566aa-2435-4538-9de3-5915e4620793 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:57:09.077979 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-1d8566aa-2435-4538-9de3-5915e4620793 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:57:09.108982 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-1d8566aa-2435-4538-9de3-5915e4620793 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:57:09.109546 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-1d8566aa-2435-4538-9de3-5915e4620793 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:57:09.110029 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.objects.instance [None req-1d8566aa-2435-4538-9de3-5915e4620793 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lazy-loading 'fault' on Instance uuid d0080e4b-6532-4e0c-8d19-cfbdf32e401b {{(pid=123546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 05 02:57:09.153461 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-1d8566aa-2435-4538-9de3-5915e4620793 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e5a000087fe40419ccd0d1a96fb4783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9d27da2e71d4962a53a95efc46518ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:57:09.161193 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-1d8566aa-2435-4538-9de3-5915e4620793 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] 10.222.0.26 "GET /compute/v2.1/servers/d0080e4b-6532-4e0c-8d19-cfbdf32e401b" status: 200 len: 1327 microversion: 2.1 time: 0.095833 Mar 05 02:57:09.170666 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 278/571] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:57:09 2022] GET /compute/v2.1/servers/d0080e4b-6532-4e0c-8d19-cfbdf32e401b => generated 1327 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 02:57:09.197722 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [req-790787be-dedf-42a3-962d-cf14ecd75056 req-ed34927d-fbec-4ba2-9189-bfdd7932dd25 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0080e4b-6532-4e0c-8d19-cfbdf32e401b", "name": "network-vif-deleted", "tag": "f5a9d7d0-d2b2-401b-bf1a-016e681e13ff"}]} {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 02:57:09.207119 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [req-790787be-dedf-42a3-962d-cf14ecd75056 req-ed34927d-fbec-4ba2-9189-bfdd7932dd25 service nova] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:57:09.207670 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [req-790787be-dedf-42a3-962d-cf14ecd75056 req-ed34927d-fbec-4ba2-9189-bfdd7932dd25 service nova] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:57:09.218682 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.compute.server_external_events [req-790787be-dedf-42a3-962d-cf14ecd75056 req-ed34927d-fbec-4ba2-9189-bfdd7932dd25 service nova] Creating event network-vif-deleted:f5a9d7d0-d2b2-401b-bf1a-016e681e13ff for instance d0080e4b-6532-4e0c-8d19-cfbdf32e401b on hv-cinder-82725 Mar 05 02:57:09.223809 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [req-790787be-dedf-42a3-962d-cf14ecd75056 req-ed34927d-fbec-4ba2-9189-bfdd7932dd25 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029825 Mar 05 02:57:09.224519 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 294/572] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Mar 5 02:57:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 02:57:09.456821 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-6f774aa2-c753-4150-8310-0260e6385d9a tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:57:09.457546 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-6f774aa2-c753-4150-8310-0260e6385d9a tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] [instance: cd7bf2d1-7563-4057-8f9b-b7e51d741a6c] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:57:09.464078 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-6f774aa2-c753-4150-8310-0260e6385d9a tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:57:09.464640 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-6f774aa2-c753-4150-8310-0260e6385d9a tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:57:09.465495 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-6f774aa2-c753-4150-8310-0260e6385d9a tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:57:09.466026 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-6f774aa2-c753-4150-8310-0260e6385d9a tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:57:09.624594 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-6f774aa2-c753-4150-8310-0260e6385d9a tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af8fb7f45f4d4eb180ccaca3d52ed2dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dd2b27540c04b4c8741ce8c9a5e2b47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:57:09.636452 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-6f774aa2-c753-4150-8310-0260e6385d9a tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] 10.222.0.26 "GET /compute/v2.1/servers/cd7bf2d1-7563-4057-8f9b-b7e51d741a6c" status: 200 len: 1366 microversion: 2.1 time: 0.183706 Mar 05 02:57:09.637044 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 279/573] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:57:09 2022] GET /compute/v2.1/servers/cd7bf2d1-7563-4057-8f9b-b7e51d741a6c => generated 1366 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 02:57:09.951830 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-16b5f33a-c203-4e20-9d7f-a1c0e34bad6d tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 02:57:09.952448 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-16b5f33a-c203-4e20-9d7f-a1c0e34bad6d tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] [instance: 1b31d7bf-888c-45a2-bc3a-e7077ad3a96d] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:57:09.959091 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-16b5f33a-c203-4e20-9d7f-a1c0e34bad6d tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:57:09.959537 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-16b5f33a-c203-4e20-9d7f-a1c0e34bad6d tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:57:09.960332 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-16b5f33a-c203-4e20-9d7f-a1c0e34bad6d tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:57:09.960762 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-16b5f33a-c203-4e20-9d7f-a1c0e34bad6d tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:57:09.983654 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.objects.instance [None req-16b5f33a-c203-4e20-9d7f-a1c0e34bad6d tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lazy-loading 'flavor' on Instance uuid 1b31d7bf-888c-45a2-bc3a-e7077ad3a96d {{(pid=123545) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 05 02:57:10.178571 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-3d49986e-5b33-4cb8-86e9-d1743871f9cc tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:57:10.179182 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-3d49986e-5b33-4cb8-86e9-d1743871f9cc tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] [instance: d0080e4b-6532-4e0c-8d19-cfbdf32e401b] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:57:10.186425 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-3d49986e-5b33-4cb8-86e9-d1743871f9cc tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:57:10.186872 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-3d49986e-5b33-4cb8-86e9-d1743871f9cc tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:57:10.187838 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-3d49986e-5b33-4cb8-86e9-d1743871f9cc tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:57:10.188268 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-3d49986e-5b33-4cb8-86e9-d1743871f9cc tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:57:10.206291 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.wsgi [None req-3d49986e-5b33-4cb8-86e9-d1743871f9cc tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] HTTP exception thrown: Instance d0080e4b-6532-4e0c-8d19-cfbdf32e401b could not be found. Mar 05 02:57:10.207074 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-3d49986e-5b33-4cb8-86e9-d1743871f9cc tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Returning 404 to user: Instance d0080e4b-6532-4e0c-8d19-cfbdf32e401b could not be found. {{(pid=123546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 02:57:10.208251 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-3d49986e-5b33-4cb8-86e9-d1743871f9cc tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] 10.222.0.26 "GET /compute/v2.1/servers/d0080e4b-6532-4e0c-8d19-cfbdf32e401b" status: 404 len: 111 microversion: 2.1 time: 0.033564 Mar 05 02:57:10.208880 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 280/574] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:57:10 2022] GET /compute/v2.1/servers/d0080e4b-6532-4e0c-8d19-cfbdf32e401b => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Mar 05 02:57:10.218888 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-13646b33-3d41-44f5-b570-d6559502a208 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Calling method '.version_select at 0x7f3f61ef1040>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:57:10.240549 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-13646b33-3d41-44f5-b570-d6559502a208 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1240062710" status: 202 len: 0 microversion: 2.1 time: 0.027019 Mar 05 02:57:10.241626 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 281/575] 10.222.0.26 () {58 vars in 1220 bytes} [Sat Mar 5 02:57:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1240062710 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Mar 05 02:57:10.244853 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-16b5f33a-c203-4e20-9d7f-a1c0e34bad6d tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] 10.222.0.26 "POST /compute/v2.1/servers/1b31d7bf-888c-45a2-bc3a-e7077ad3a96d/action" status: 202 len: 0 microversion: 2.20 time: 0.296619 Mar 05 02:57:10.246556 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 295/576] 10.222.0.26 () {62 vars in 1318 bytes} [Sat Mar 5 02:57:09 2022] POST /compute/v2.1/servers/1b31d7bf-888c-45a2-bc3a-e7077ad3a96d/action => generated 0 bytes in 300 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Mar 05 02:57:10.257762 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-d316af79-7a90-4fad-b4fe-bb18375c7f64 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:57:10.258576 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-d316af79-7a90-4fad-b4fe-bb18375c7f64 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] [instance: 1b31d7bf-888c-45a2-bc3a-e7077ad3a96d] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:57:10.267042 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-d316af79-7a90-4fad-b4fe-bb18375c7f64 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:57:10.267831 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-d316af79-7a90-4fad-b4fe-bb18375c7f64 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:57:10.270675 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-d316af79-7a90-4fad-b4fe-bb18375c7f64 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:57:10.271513 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-d316af79-7a90-4fad-b4fe-bb18375c7f64 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:57:10.654566 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-1368d515-dbdb-4ca4-80df-32a53f7849df tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:57:10.655699 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-1368d515-dbdb-4ca4-80df-32a53f7849df tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] [instance: cd7bf2d1-7563-4057-8f9b-b7e51d741a6c] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:57:10.662554 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-1368d515-dbdb-4ca4-80df-32a53f7849df tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:57:10.663122 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-1368d515-dbdb-4ca4-80df-32a53f7849df tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:57:10.663964 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-1368d515-dbdb-4ca4-80df-32a53f7849df tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:57:10.664462 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-1368d515-dbdb-4ca4-80df-32a53f7849df tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:57:10.817628 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-d316af79-7a90-4fad-b4fe-bb18375c7f64 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:57:10.826151 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-d316af79-7a90-4fad-b4fe-bb18375c7f64 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:57:10.828047 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-d316af79-7a90-4fad-b4fe-bb18375c7f64 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:57:10.829497 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-d316af79-7a90-4fad-b4fe-bb18375c7f64 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] 10.222.0.26 "GET /compute/v2.1/servers/1b31d7bf-888c-45a2-bc3a-e7077ad3a96d" status: 200 len: 1721 microversion: 2.20 time: 0.576292 Mar 05 02:57:10.831416 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 282/577] 10.222.0.26 () {60 vars in 1276 bytes} [Sat Mar 5 02:57:10 2022] GET /compute/v2.1/servers/1b31d7bf-888c-45a2-bc3a-e7077ad3a96d => generated 1721 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 02:57:10.975682 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-1368d515-dbdb-4ca4-80df-32a53f7849df tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af8fb7f45f4d4eb180ccaca3d52ed2dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dd2b27540c04b4c8741ce8c9a5e2b47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:57:10.983967 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-1368d515-dbdb-4ca4-80df-32a53f7849df tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] 10.222.0.26 "GET /compute/v2.1/servers/cd7bf2d1-7563-4057-8f9b-b7e51d741a6c" status: 200 len: 1366 microversion: 2.1 time: 0.333441 Mar 05 02:57:10.984882 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 296/578] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:57:10 2022] GET /compute/v2.1/servers/cd7bf2d1-7563-4057-8f9b-b7e51d741a6c => generated 1366 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 02:57:11.193920 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-2f59ea51-ea69-444d-ae5f-eef2dbe9552b tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Action: 'create', calling method: .version_select at 0x7f3f61d7adc0>, body: {"keypair": {"name": "tempest-keypair-935484592"}} {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 02:57:11.207967 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.quota [None req-2f59ea51-ea69-444d-ae5f-eef2dbe9552b tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Getting quotas for project b9d27da2e71d4962a53a95efc46518ea. Resources: {'key_pairs'} {{(pid=123546) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 02:57:11.211677 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.quota [None req-2f59ea51-ea69-444d-ae5f-eef2dbe9552b tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Getting quotas for user 5e5a000087fe40419ccd0d1a96fb4783 and project b9d27da2e71d4962a53a95efc46518ea. Resources: {'key_pairs'} {{(pid=123546) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 02:57:11.672397 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.quota [None req-2f59ea51-ea69-444d-ae5f-eef2dbe9552b tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Getting quotas for project b9d27da2e71d4962a53a95efc46518ea. Resources: {'key_pairs'} {{(pid=123546) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 02:57:11.676766 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.quota [None req-2f59ea51-ea69-444d-ae5f-eef2dbe9552b tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Getting quotas for user 5e5a000087fe40419ccd0d1a96fb4783 and project b9d27da2e71d4962a53a95efc46518ea. Resources: {'key_pairs'} {{(pid=123546) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 02:57:11.689711 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-2f59ea51-ea69-444d-ae5f-eef2dbe9552b tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 2304 microversion: 2.1 time: 0.499779 Mar 05 02:57:11.690340 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 283/579] 10.222.0.26 () {60 vars in 1157 bytes} [Sat Mar 5 02:57:11 2022] POST /compute/v2.1/os-keypairs => generated 2304 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 02:57:11.850045 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-9e3af574-5c79-4843-a701-d8d88722b225 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:57:11.850732 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-9e3af574-5c79-4843-a701-d8d88722b225 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] [instance: 1b31d7bf-888c-45a2-bc3a-e7077ad3a96d] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:57:11.857277 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-9e3af574-5c79-4843-a701-d8d88722b225 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:57:11.857731 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-9e3af574-5c79-4843-a701-d8d88722b225 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:57:11.858538 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-9e3af574-5c79-4843-a701-d8d88722b225 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:57:11.858978 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-9e3af574-5c79-4843-a701-d8d88722b225 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:57:12.001136 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-d567a7bd-f54c-476a-86d2-d078466d8b11 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:57:12.003090 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-d567a7bd-f54c-476a-86d2-d078466d8b11 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] [instance: cd7bf2d1-7563-4057-8f9b-b7e51d741a6c] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:57:12.009213 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-d567a7bd-f54c-476a-86d2-d078466d8b11 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:57:12.009670 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-d567a7bd-f54c-476a-86d2-d078466d8b11 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:57:12.010476 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-d567a7bd-f54c-476a-86d2-d078466d8b11 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:57:12.010912 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-d567a7bd-f54c-476a-86d2-d078466d8b11 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:57:12.042096 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-9e3af574-5c79-4843-a701-d8d88722b225 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:57:12.051368 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-9e3af574-5c79-4843-a701-d8d88722b225 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:57:12.053018 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-9e3af574-5c79-4843-a701-d8d88722b225 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:57:12.054280 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-9e3af574-5c79-4843-a701-d8d88722b225 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] 10.222.0.26 "GET /compute/v2.1/servers/1b31d7bf-888c-45a2-bc3a-e7077ad3a96d" status: 200 len: 1721 microversion: 2.20 time: 0.209071 Mar 05 02:57:12.055070 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 297/580] 10.222.0.26 () {60 vars in 1276 bytes} [Sat Mar 5 02:57:11 2022] GET /compute/v2.1/servers/1b31d7bf-888c-45a2-bc3a-e7077ad3a96d => generated 1721 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 02:57:12.161571 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-d567a7bd-f54c-476a-86d2-d078466d8b11 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af8fb7f45f4d4eb180ccaca3d52ed2dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dd2b27540c04b4c8741ce8c9a5e2b47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:57:12.169114 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-d567a7bd-f54c-476a-86d2-d078466d8b11 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] 10.222.0.26 "GET /compute/v2.1/servers/cd7bf2d1-7563-4057-8f9b-b7e51d741a6c" status: 200 len: 1366 microversion: 2.1 time: 0.171834 Mar 05 02:57:12.169892 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 284/581] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:57:11 2022] GET /compute/v2.1/servers/cd7bf2d1-7563-4057-8f9b-b7e51d741a6c => generated 1366 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 02:57:12.397475 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [req-4784cbfa-7cb9-4388-a0e4-fd15530af401 req-e2517de2-fdd1-4af4-acf9-af5ada3353db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd7bf2d1-7563-4057-8f9b-b7e51d741a6c", "name": "network-vif-plugged", "status": "completed", "tag": "e30d5b85-41e6-47b6-930e-a7a045a9d2fb"}]} {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 02:57:12.408720 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [req-4784cbfa-7cb9-4388-a0e4-fd15530af401 req-e2517de2-fdd1-4af4-acf9-af5ada3353db service nova] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:57:12.409174 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [req-4784cbfa-7cb9-4388-a0e4-fd15530af401 req-e2517de2-fdd1-4af4-acf9-af5ada3353db service nova] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:57:12.420099 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.compute.server_external_events [req-4784cbfa-7cb9-4388-a0e4-fd15530af401 req-e2517de2-fdd1-4af4-acf9-af5ada3353db service nova] Creating event network-vif-plugged:e30d5b85-41e6-47b6-930e-a7a045a9d2fb for instance cd7bf2d1-7563-4057-8f9b-b7e51d741a6c on hv-cinder-82725 Mar 05 02:57:12.425771 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [req-4784cbfa-7cb9-4388-a0e4-fd15530af401 req-e2517de2-fdd1-4af4-acf9-af5ada3353db service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032447 Mar 05 02:57:12.426733 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 298/582] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Mar 5 02:57:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 02:57:13.074134 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-7df01488-9a80-453f-a041-8c6966f6646a tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:57:13.074750 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-7df01488-9a80-453f-a041-8c6966f6646a tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] [instance: 1b31d7bf-888c-45a2-bc3a-e7077ad3a96d] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:57:13.080973 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-7df01488-9a80-453f-a041-8c6966f6646a tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:57:13.081435 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-7df01488-9a80-453f-a041-8c6966f6646a tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:57:13.082242 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-7df01488-9a80-453f-a041-8c6966f6646a tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:57:13.082691 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-7df01488-9a80-453f-a041-8c6966f6646a tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:57:13.113540 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-c66986d3-49f0-4212-88a0-e8eea13f1894 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-949568201", "imageRef": "adbc7df1-116e-4f9f-a28d-a6a3c084cceb", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "691722ee-1aea-4c34-b285-794aff5b5741"}], "security_groups": [{"name": "tempest-securitygroup--1112611589"}], "key_name": "tempest-keypair-935484592", "user_data": "}} {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 02:57:13.242982 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-7df01488-9a80-453f-a041-8c6966f6646a tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:57:13.244786 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.network.neutron [None req-c66986d3-49f0-4212-88a0-e8eea13f1894 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] validate_networks() for [('691722ee-1aea-4c34-b285-794aff5b5741', None, None, None, None, None)] {{(pid=123545) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 05 02:57:13.251114 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-7df01488-9a80-453f-a041-8c6966f6646a tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:57:13.252669 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-7df01488-9a80-453f-a041-8c6966f6646a tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:57:13.253826 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-7df01488-9a80-453f-a041-8c6966f6646a tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] 10.222.0.26 "GET /compute/v2.1/servers/1b31d7bf-888c-45a2-bc3a-e7077ad3a96d" status: 200 len: 1721 microversion: 2.20 time: 0.183680 Mar 05 02:57:13.254422 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 285/583] 10.222.0.26 () {60 vars in 1276 bytes} [Sat Mar 5 02:57:13 2022] GET /compute/v2.1/servers/1b31d7bf-888c-45a2-bc3a-e7077ad3a96d => generated 1721 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 02:57:13.258755 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-60b932b2-cc70-4457-a04f-ef1b929b6fa5 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:57:13.259357 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-60b932b2-cc70-4457-a04f-ef1b929b6fa5 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] [instance: cd7bf2d1-7563-4057-8f9b-b7e51d741a6c] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:57:13.264975 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-60b932b2-cc70-4457-a04f-ef1b929b6fa5 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:57:13.265636 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-60b932b2-cc70-4457-a04f-ef1b929b6fa5 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:57:13.266425 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-60b932b2-cc70-4457-a04f-ef1b929b6fa5 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:57:13.266856 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-60b932b2-cc70-4457-a04f-ef1b929b6fa5 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:57:13.484190 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-60b932b2-cc70-4457-a04f-ef1b929b6fa5 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af8fb7f45f4d4eb180ccaca3d52ed2dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dd2b27540c04b4c8741ce8c9a5e2b47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:57:13.491677 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-60b932b2-cc70-4457-a04f-ef1b929b6fa5 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] 10.222.0.26 "GET /compute/v2.1/servers/cd7bf2d1-7563-4057-8f9b-b7e51d741a6c" status: 200 len: 1366 microversion: 2.1 time: 0.236290 Mar 05 02:57:13.492254 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 286/584] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:57:13 2022] GET /compute/v2.1/servers/cd7bf2d1-7563-4057-8f9b-b7e51d741a6c => generated 1366 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 02:57:13.677371 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.virt.hardware [None req-c66986d3-49f0-4212-88a0-e8eea13f1894 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Flavor limits 0:0:0 {{(pid=123545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 05 02:57:13.677798 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.virt.hardware [None req-c66986d3-49f0-4212-88a0-e8eea13f1894 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Image limits 0:0:0 {{(pid=123545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 05 02:57:13.678303 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.virt.hardware [None req-c66986d3-49f0-4212-88a0-e8eea13f1894 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Flavor pref 0:0:0 {{(pid=123545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 05 02:57:13.678712 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.virt.hardware [None req-c66986d3-49f0-4212-88a0-e8eea13f1894 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Image pref 0:0:0 {{(pid=123545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 05 02:57:13.679119 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.virt.hardware [None req-c66986d3-49f0-4212-88a0-e8eea13f1894 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 05 02:57:13.687662 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-c66986d3-49f0-4212-88a0-e8eea13f1894 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:57:13.688093 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-c66986d3-49f0-4212-88a0-e8eea13f1894 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:57:13.689451 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-c66986d3-49f0-4212-88a0-e8eea13f1894 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:57:13.690458 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-c66986d3-49f0-4212-88a0-e8eea13f1894 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:57:13.707573 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.quota [None req-c66986d3-49f0-4212-88a0-e8eea13f1894 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Getting quotas for project b9d27da2e71d4962a53a95efc46518ea. Resources: {'ram', 'cores', 'instances'} {{(pid=123545) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 02:57:13.711593 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.quota [None req-c66986d3-49f0-4212-88a0-e8eea13f1894 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Getting quotas for user 5e5a000087fe40419ccd0d1a96fb4783 and project b9d27da2e71d4962a53a95efc46518ea. Resources: {'ram', 'cores', 'instances'} {{(pid=123545) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 02:57:13.723069 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-c66986d3-49f0-4212-88a0-e8eea13f1894 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Going to run 1 instances... {{(pid=123545) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 05 02:57:13.725443 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-c66986d3-49f0-4212-88a0-e8eea13f1894 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] [instance: 4f97c839-ad1c-4b04-ac59-460b0de295ed] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='adbc7df1-116e-4f9f-a28d-a6a3c084cceb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123545) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 05 02:57:13.773970 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-c66986d3-49f0-4212-88a0-e8eea13f1894 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.665558 Mar 05 02:57:13.774704 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 299/585] 10.222.0.26 () {60 vars in 1146 bytes} [Sat Mar 5 02:57:13 2022] POST /compute/v2.1/servers => generated 402 bytes in 667 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Mar 05 02:57:13.784992 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-1adefe4c-aaf3-4247-9364-a1f9c8d64e18 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:57:13.785611 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-1adefe4c-aaf3-4247-9364-a1f9c8d64e18 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] [instance: 4f97c839-ad1c-4b04-ac59-460b0de295ed] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:57:13.855356 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-1adefe4c-aaf3-4247-9364-a1f9c8d64e18 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e5a000087fe40419ccd0d1a96fb4783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9d27da2e71d4962a53a95efc46518ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:57:13.861846 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-1adefe4c-aaf3-4247-9364-a1f9c8d64e18 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] 10.222.0.26 "GET /compute/v2.1/servers/4f97c839-ad1c-4b04-ac59-460b0de295ed" status: 200 len: 1236 microversion: 2.1 time: 0.080846 Mar 05 02:57:13.862784 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 287/586] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:57:13 2022] GET /compute/v2.1/servers/4f97c839-ad1c-4b04-ac59-460b0de295ed => generated 1236 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 02:57:14.272967 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-9a21eb42-783d-4752-97aa-9655049989ee tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:57:14.273582 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-9a21eb42-783d-4752-97aa-9655049989ee tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] [instance: 1b31d7bf-888c-45a2-bc3a-e7077ad3a96d] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:57:14.279760 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-9a21eb42-783d-4752-97aa-9655049989ee tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:57:14.280212 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-9a21eb42-783d-4752-97aa-9655049989ee tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:57:14.280991 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-9a21eb42-783d-4752-97aa-9655049989ee tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:57:14.281428 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-9a21eb42-783d-4752-97aa-9655049989ee tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:57:14.417097 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-9a21eb42-783d-4752-97aa-9655049989ee tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:57:14.425606 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-9a21eb42-783d-4752-97aa-9655049989ee tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:57:14.427184 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-9a21eb42-783d-4752-97aa-9655049989ee tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:57:14.428343 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-9a21eb42-783d-4752-97aa-9655049989ee tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] 10.222.0.26 "GET /compute/v2.1/servers/1b31d7bf-888c-45a2-bc3a-e7077ad3a96d" status: 200 len: 1721 microversion: 2.20 time: 0.159796 Mar 05 02:57:14.428908 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 300/587] 10.222.0.26 () {60 vars in 1276 bytes} [Sat Mar 5 02:57:14 2022] GET /compute/v2.1/servers/1b31d7bf-888c-45a2-bc3a-e7077ad3a96d => generated 1721 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 02:57:14.508589 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-243df540-94ca-49ad-99cc-af333545cb84 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:57:14.509139 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-243df540-94ca-49ad-99cc-af333545cb84 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] [instance: cd7bf2d1-7563-4057-8f9b-b7e51d741a6c] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:57:14.515461 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-243df540-94ca-49ad-99cc-af333545cb84 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:57:14.515913 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-243df540-94ca-49ad-99cc-af333545cb84 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:57:14.516679 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-243df540-94ca-49ad-99cc-af333545cb84 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:57:14.517119 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-243df540-94ca-49ad-99cc-af333545cb84 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:57:14.654061 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-243df540-94ca-49ad-99cc-af333545cb84 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af8fb7f45f4d4eb180ccaca3d52ed2dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dd2b27540c04b4c8741ce8c9a5e2b47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:57:14.661371 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-243df540-94ca-49ad-99cc-af333545cb84 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] 10.222.0.26 "GET /compute/v2.1/servers/cd7bf2d1-7563-4057-8f9b-b7e51d741a6c" status: 200 len: 1556 microversion: 2.1 time: 0.156757 Mar 05 02:57:14.661941 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 288/588] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:57:14 2022] GET /compute/v2.1/servers/cd7bf2d1-7563-4057-8f9b-b7e51d741a6c => generated 1556 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 02:57:14.678017 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-206430ba-c8e3-496e-9303-35cbade9469f tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:57:14.678517 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-206430ba-c8e3-496e-9303-35cbade9469f tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] [instance: cd7bf2d1-7563-4057-8f9b-b7e51d741a6c] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:57:14.684456 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-206430ba-c8e3-496e-9303-35cbade9469f tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:57:14.684910 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-206430ba-c8e3-496e-9303-35cbade9469f tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:57:14.685680 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-206430ba-c8e3-496e-9303-35cbade9469f tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:57:14.686157 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-206430ba-c8e3-496e-9303-35cbade9469f tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:57:14.771528 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-206430ba-c8e3-496e-9303-35cbade9469f tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] 10.222.0.26 "GET /compute/v2.1/servers/cd7bf2d1-7563-4057-8f9b-b7e51d741a6c/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.098045 Mar 05 02:57:14.772128 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 301/589] 10.222.0.26 () {58 vars in 1274 bytes} [Sat Mar 5 02:57:14 2022] GET /compute/v2.1/servers/cd7bf2d1-7563-4057-8f9b-b7e51d741a6c/os-interface => generated 285 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 02:57:14.879302 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-996eb33c-4252-4e89-88c2-7217abb1cf8a tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:57:14.880582 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-996eb33c-4252-4e89-88c2-7217abb1cf8a tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] [instance: 4f97c839-ad1c-4b04-ac59-460b0de295ed] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:57:14.885770 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-996eb33c-4252-4e89-88c2-7217abb1cf8a tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:57:14.886252 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-996eb33c-4252-4e89-88c2-7217abb1cf8a tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:57:14.887024 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-996eb33c-4252-4e89-88c2-7217abb1cf8a tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:57:14.887457 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-996eb33c-4252-4e89-88c2-7217abb1cf8a tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:57:14.976174 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-996eb33c-4252-4e89-88c2-7217abb1cf8a tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e5a000087fe40419ccd0d1a96fb4783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9d27da2e71d4962a53a95efc46518ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:57:14.984032 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-996eb33c-4252-4e89-88c2-7217abb1cf8a tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] 10.222.0.26 "GET /compute/v2.1/servers/4f97c839-ad1c-4b04-ac59-460b0de295ed" status: 200 len: 1306 microversion: 2.1 time: 0.109218 Mar 05 02:57:14.984466 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 289/590] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:57:14 2022] GET /compute/v2.1/servers/4f97c839-ad1c-4b04-ac59-460b0de295ed => generated 1306 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 02:57:15.447423 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-9de37fc3-54e6-4fa9-9543-75156fc4de54 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:57:15.448034 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-9de37fc3-54e6-4fa9-9543-75156fc4de54 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] [instance: 1b31d7bf-888c-45a2-bc3a-e7077ad3a96d] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:57:15.453963 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-9de37fc3-54e6-4fa9-9543-75156fc4de54 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:57:15.454439 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-9de37fc3-54e6-4fa9-9543-75156fc4de54 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:57:15.456253 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-9de37fc3-54e6-4fa9-9543-75156fc4de54 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:57:15.456775 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-9de37fc3-54e6-4fa9-9543-75156fc4de54 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:57:16.002430 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-bf596d28-564f-4486-b4b0-86dc39b4691f tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:57:16.003585 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-bf596d28-564f-4486-b4b0-86dc39b4691f tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] [instance: 4f97c839-ad1c-4b04-ac59-460b0de295ed] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:57:16.009266 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-bf596d28-564f-4486-b4b0-86dc39b4691f tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:57:16.009726 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-bf596d28-564f-4486-b4b0-86dc39b4691f tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:57:16.010527 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-bf596d28-564f-4486-b4b0-86dc39b4691f tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:57:16.010965 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-bf596d28-564f-4486-b4b0-86dc39b4691f tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:57:16.063866 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-9de37fc3-54e6-4fa9-9543-75156fc4de54 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:57:16.072185 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-9de37fc3-54e6-4fa9-9543-75156fc4de54 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:57:16.073680 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-9de37fc3-54e6-4fa9-9543-75156fc4de54 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:57:16.074860 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-9de37fc3-54e6-4fa9-9543-75156fc4de54 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] 10.222.0.26 "GET /compute/v2.1/servers/1b31d7bf-888c-45a2-bc3a-e7077ad3a96d" status: 200 len: 1721 microversion: 2.20 time: 0.631927 Mar 05 02:57:16.075429 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 302/591] 10.222.0.26 () {60 vars in 1276 bytes} [Sat Mar 5 02:57:15 2022] GET /compute/v2.1/servers/1b31d7bf-888c-45a2-bc3a-e7077ad3a96d => generated 1721 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 02:57:16.114311 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-bf596d28-564f-4486-b4b0-86dc39b4691f tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e5a000087fe40419ccd0d1a96fb4783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9d27da2e71d4962a53a95efc46518ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:57:16.121934 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-bf596d28-564f-4486-b4b0-86dc39b4691f tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] 10.222.0.26 "GET /compute/v2.1/servers/4f97c839-ad1c-4b04-ac59-460b0de295ed" status: 200 len: 1294 microversion: 2.1 time: 0.123878 Mar 05 02:57:16.122533 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 290/592] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:57:15 2022] GET /compute/v2.1/servers/4f97c839-ad1c-4b04-ac59-460b0de295ed => generated 1294 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 02:57:16.657385 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [req-919c4e99-6eca-4511-b9f3-8bc8cf52a28b req-6c117dd1-f047-4103-a09d-e0eb7ecf5125 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cd7bf2d1-7563-4057-8f9b-b7e51d741a6c", "tag": "e30d5b85-41e6-47b6-930e-a7a045a9d2fb"}]} {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 02:57:16.667154 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [req-919c4e99-6eca-4511-b9f3-8bc8cf52a28b req-6c117dd1-f047-4103-a09d-e0eb7ecf5125 service nova] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:57:16.667642 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [req-919c4e99-6eca-4511-b9f3-8bc8cf52a28b req-6c117dd1-f047-4103-a09d-e0eb7ecf5125 service nova] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:57:16.684623 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.compute.server_external_events [req-919c4e99-6eca-4511-b9f3-8bc8cf52a28b req-6c117dd1-f047-4103-a09d-e0eb7ecf5125 service nova] Creating event network-changed:e30d5b85-41e6-47b6-930e-a7a045a9d2fb for instance cd7bf2d1-7563-4057-8f9b-b7e51d741a6c on hv-cinder-82725 Mar 05 02:57:16.690511 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [req-919c4e99-6eca-4511-b9f3-8bc8cf52a28b req-6c117dd1-f047-4103-a09d-e0eb7ecf5125 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037222 Mar 05 02:57:16.691803 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 303/593] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Mar 5 02:57:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 02:57:17.094894 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-b6c1abc1-3db4-4c54-8be8-f8ceb662d420 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:57:17.095414 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-b6c1abc1-3db4-4c54-8be8-f8ceb662d420 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] [instance: 1b31d7bf-888c-45a2-bc3a-e7077ad3a96d] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:57:17.103006 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-b6c1abc1-3db4-4c54-8be8-f8ceb662d420 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:57:17.103713 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-b6c1abc1-3db4-4c54-8be8-f8ceb662d420 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:57:17.104487 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-b6c1abc1-3db4-4c54-8be8-f8ceb662d420 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:57:17.104917 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-b6c1abc1-3db4-4c54-8be8-f8ceb662d420 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:57:17.140604 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-4077a38d-70e6-4348-907e-642e3080e880 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:57:17.141510 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-4077a38d-70e6-4348-907e-642e3080e880 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] [instance: 4f97c839-ad1c-4b04-ac59-460b0de295ed] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:57:17.148623 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-4077a38d-70e6-4348-907e-642e3080e880 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:57:17.149368 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-4077a38d-70e6-4348-907e-642e3080e880 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:57:17.150246 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-4077a38d-70e6-4348-907e-642e3080e880 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:57:17.150879 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-4077a38d-70e6-4348-907e-642e3080e880 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:57:17.521687 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-b6c1abc1-3db4-4c54-8be8-f8ceb662d420 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:57:17.536994 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-b6c1abc1-3db4-4c54-8be8-f8ceb662d420 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:57:17.539087 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-b6c1abc1-3db4-4c54-8be8-f8ceb662d420 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:57:17.540511 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-b6c1abc1-3db4-4c54-8be8-f8ceb662d420 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] 10.222.0.26 "GET /compute/v2.1/servers/1b31d7bf-888c-45a2-bc3a-e7077ad3a96d" status: 200 len: 1721 microversion: 2.20 time: 0.451238 Mar 05 02:57:17.541673 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 291/594] 10.222.0.26 () {60 vars in 1276 bytes} [Sat Mar 5 02:57:17 2022] GET /compute/v2.1/servers/1b31d7bf-888c-45a2-bc3a-e7077ad3a96d => generated 1721 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 02:57:17.565982 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-4077a38d-70e6-4348-907e-642e3080e880 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e5a000087fe40419ccd0d1a96fb4783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9d27da2e71d4962a53a95efc46518ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:57:17.575825 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-4077a38d-70e6-4348-907e-642e3080e880 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] 10.222.0.26 "GET /compute/v2.1/servers/4f97c839-ad1c-4b04-ac59-460b0de295ed" status: 200 len: 1362 microversion: 2.1 time: 0.439156 Mar 05 02:57:17.586490 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 304/595] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:57:17 2022] GET /compute/v2.1/servers/4f97c839-ad1c-4b04-ac59-460b0de295ed => generated 1362 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 02:57:18.559788 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-853d7350-3100-442f-9994-1be856e5b396 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:57:18.560314 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-853d7350-3100-442f-9994-1be856e5b396 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] [instance: 1b31d7bf-888c-45a2-bc3a-e7077ad3a96d] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:57:18.567270 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-853d7350-3100-442f-9994-1be856e5b396 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:57:18.567712 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-853d7350-3100-442f-9994-1be856e5b396 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:57:18.568471 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-853d7350-3100-442f-9994-1be856e5b396 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:57:18.568901 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-853d7350-3100-442f-9994-1be856e5b396 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:57:18.592430 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-993f54d3-398f-4290-bee4-18acf4e430cb tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:57:18.593231 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-993f54d3-398f-4290-bee4-18acf4e430cb tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] [instance: 4f97c839-ad1c-4b04-ac59-460b0de295ed] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:57:18.599416 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-993f54d3-398f-4290-bee4-18acf4e430cb tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:57:18.599863 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-993f54d3-398f-4290-bee4-18acf4e430cb tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:57:18.600622 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-993f54d3-398f-4290-bee4-18acf4e430cb tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:57:18.601050 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-993f54d3-398f-4290-bee4-18acf4e430cb tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:57:18.767384 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-853d7350-3100-442f-9994-1be856e5b396 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:57:18.775455 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-853d7350-3100-442f-9994-1be856e5b396 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:57:18.777067 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-853d7350-3100-442f-9994-1be856e5b396 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:57:18.778343 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-853d7350-3100-442f-9994-1be856e5b396 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] 10.222.0.26 "GET /compute/v2.1/servers/1b31d7bf-888c-45a2-bc3a-e7077ad3a96d" status: 200 len: 1721 microversion: 2.20 time: 0.222499 Mar 05 02:57:18.778903 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 292/596] 10.222.0.26 () {60 vars in 1276 bytes} [Sat Mar 5 02:57:18 2022] GET /compute/v2.1/servers/1b31d7bf-888c-45a2-bc3a-e7077ad3a96d => generated 1721 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 02:57:18.784054 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [req-70ec2ca6-5fd2-4908-bc29-98ff97e8267a req-cfd418fb-4743-42ff-86a4-385e0c6bbc3c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4f97c839-ad1c-4b04-ac59-460b0de295ed", "tag": "00972e01-aaaf-4d40-a722-75829a58b00f"}]} {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 02:57:18.788932 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-993f54d3-398f-4290-bee4-18acf4e430cb tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e5a000087fe40419ccd0d1a96fb4783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9d27da2e71d4962a53a95efc46518ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:57:18.791922 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [req-70ec2ca6-5fd2-4908-bc29-98ff97e8267a req-cfd418fb-4743-42ff-86a4-385e0c6bbc3c service nova] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:57:18.792582 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [req-70ec2ca6-5fd2-4908-bc29-98ff97e8267a req-cfd418fb-4743-42ff-86a4-385e0c6bbc3c service nova] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:57:18.797068 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-993f54d3-398f-4290-bee4-18acf4e430cb tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] 10.222.0.26 "GET /compute/v2.1/servers/4f97c839-ad1c-4b04-ac59-460b0de295ed" status: 200 len: 1362 microversion: 2.1 time: 0.208394 Mar 05 02:57:18.797879 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 305/597] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:57:18 2022] GET /compute/v2.1/servers/4f97c839-ad1c-4b04-ac59-460b0de295ed => generated 1362 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 02:57:18.804365 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.compute.server_external_events [req-70ec2ca6-5fd2-4908-bc29-98ff97e8267a req-cfd418fb-4743-42ff-86a4-385e0c6bbc3c service nova] Creating event network-changed:00972e01-aaaf-4d40-a722-75829a58b00f for instance 4f97c839-ad1c-4b04-ac59-460b0de295ed on hv-cinder-82725 Mar 05 02:57:18.809510 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [req-70ec2ca6-5fd2-4908-bc29-98ff97e8267a req-cfd418fb-4743-42ff-86a4-385e0c6bbc3c service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029521 Mar 05 02:57:18.810203 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 293/598] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Mar 5 02:57:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 02:57:19.816308 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-a0dfc322-9625-4fe9-b198-df595ad94454 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:57:19.817095 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-a0dfc322-9625-4fe9-b198-df595ad94454 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] [instance: 4f97c839-ad1c-4b04-ac59-460b0de295ed] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:57:19.823107 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-a0dfc322-9625-4fe9-b198-df595ad94454 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:57:19.823587 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-a0dfc322-9625-4fe9-b198-df595ad94454 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:57:19.824334 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-a0dfc322-9625-4fe9-b198-df595ad94454 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:57:19.824773 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-a0dfc322-9625-4fe9-b198-df595ad94454 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:57:19.899883 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-4c02c1d8-e374-41bd-b477-5f584c01f75d tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:57:19.900498 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-4c02c1d8-e374-41bd-b477-5f584c01f75d tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] [instance: 1b31d7bf-888c-45a2-bc3a-e7077ad3a96d] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:57:19.906334 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-4c02c1d8-e374-41bd-b477-5f584c01f75d tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:57:19.906821 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-4c02c1d8-e374-41bd-b477-5f584c01f75d tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:57:19.907709 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-4c02c1d8-e374-41bd-b477-5f584c01f75d tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:57:19.908146 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-4c02c1d8-e374-41bd-b477-5f584c01f75d tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:57:19.984589 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-a0dfc322-9625-4fe9-b198-df595ad94454 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e5a000087fe40419ccd0d1a96fb4783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9d27da2e71d4962a53a95efc46518ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:57:19.992359 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-a0dfc322-9625-4fe9-b198-df595ad94454 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] 10.222.0.26 "GET /compute/v2.1/servers/4f97c839-ad1c-4b04-ac59-460b0de295ed" status: 200 len: 1362 microversion: 2.1 time: 0.181142 Mar 05 02:57:19.992933 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 294/599] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:57:19 2022] GET /compute/v2.1/servers/4f97c839-ad1c-4b04-ac59-460b0de295ed => generated 1362 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 02:57:20.054071 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-4c02c1d8-e374-41bd-b477-5f584c01f75d tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:57:20.061698 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-4c02c1d8-e374-41bd-b477-5f584c01f75d tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:57:20.063215 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-4c02c1d8-e374-41bd-b477-5f584c01f75d tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:57:20.065137 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-4c02c1d8-e374-41bd-b477-5f584c01f75d tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] 10.222.0.26 "GET /compute/v2.1/servers/1b31d7bf-888c-45a2-bc3a-e7077ad3a96d" status: 200 len: 1721 microversion: 2.20 time: 0.271592 Mar 05 02:57:20.065870 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 306/600] 10.222.0.26 () {60 vars in 1276 bytes} [Sat Mar 5 02:57:19 2022] GET /compute/v2.1/servers/1b31d7bf-888c-45a2-bc3a-e7077ad3a96d => generated 1721 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 02:57:21.008411 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-77bc5325-cf16-42c7-831b-1e206797809a tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:57:21.008984 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-77bc5325-cf16-42c7-831b-1e206797809a tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] [instance: 4f97c839-ad1c-4b04-ac59-460b0de295ed] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:57:21.015459 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-77bc5325-cf16-42c7-831b-1e206797809a tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:57:21.015956 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-77bc5325-cf16-42c7-831b-1e206797809a tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:57:21.016823 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-77bc5325-cf16-42c7-831b-1e206797809a tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:57:21.017858 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-77bc5325-cf16-42c7-831b-1e206797809a tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:57:21.084204 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-d3c835ea-5374-465e-8176-56eb6bbf0df0 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:57:21.084826 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-d3c835ea-5374-465e-8176-56eb6bbf0df0 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] [instance: 1b31d7bf-888c-45a2-bc3a-e7077ad3a96d] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:57:21.091457 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-d3c835ea-5374-465e-8176-56eb6bbf0df0 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:57:21.091756 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-d3c835ea-5374-465e-8176-56eb6bbf0df0 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:57:21.092525 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-d3c835ea-5374-465e-8176-56eb6bbf0df0 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:57:21.092957 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-d3c835ea-5374-465e-8176-56eb6bbf0df0 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:57:21.180138 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-77bc5325-cf16-42c7-831b-1e206797809a tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e5a000087fe40419ccd0d1a96fb4783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9d27da2e71d4962a53a95efc46518ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:57:21.187461 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-77bc5325-cf16-42c7-831b-1e206797809a tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] 10.222.0.26 "GET /compute/v2.1/servers/4f97c839-ad1c-4b04-ac59-460b0de295ed" status: 200 len: 1362 microversion: 2.1 time: 0.183037 Mar 05 02:57:21.188049 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 295/601] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:57:21 2022] GET /compute/v2.1/servers/4f97c839-ad1c-4b04-ac59-460b0de295ed => generated 1362 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 02:57:21.245286 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-d3c835ea-5374-465e-8176-56eb6bbf0df0 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:57:21.253602 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-d3c835ea-5374-465e-8176-56eb6bbf0df0 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:57:21.255164 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-d3c835ea-5374-465e-8176-56eb6bbf0df0 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:57:21.256323 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-d3c835ea-5374-465e-8176-56eb6bbf0df0 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] 10.222.0.26 "GET /compute/v2.1/servers/1b31d7bf-888c-45a2-bc3a-e7077ad3a96d" status: 200 len: 1742 microversion: 2.20 time: 0.176867 Mar 05 02:57:21.256885 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 307/602] 10.222.0.26 () {60 vars in 1276 bytes} [Sat Mar 5 02:57:21 2022] GET /compute/v2.1/servers/1b31d7bf-888c-45a2-bc3a-e7077ad3a96d => generated 1742 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 05 02:57:22.205881 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-257d48e9-7ec2-47ab-891a-b591aea314d6 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:57:22.206536 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-257d48e9-7ec2-47ab-891a-b591aea314d6 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] [instance: 4f97c839-ad1c-4b04-ac59-460b0de295ed] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:57:22.213041 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-257d48e9-7ec2-47ab-891a-b591aea314d6 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:57:22.213488 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-257d48e9-7ec2-47ab-891a-b591aea314d6 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:57:22.214285 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-257d48e9-7ec2-47ab-891a-b591aea314d6 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:57:22.214719 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-257d48e9-7ec2-47ab-891a-b591aea314d6 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:57:22.276055 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-2c093167-c7e5-4980-b6ab-567cbd417134 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:57:22.276693 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-2c093167-c7e5-4980-b6ab-567cbd417134 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] [instance: 1b31d7bf-888c-45a2-bc3a-e7077ad3a96d] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:57:22.283393 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-2c093167-c7e5-4980-b6ab-567cbd417134 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:57:22.284850 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-2c093167-c7e5-4980-b6ab-567cbd417134 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:57:22.285065 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-2c093167-c7e5-4980-b6ab-567cbd417134 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:57:22.285501 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-2c093167-c7e5-4980-b6ab-567cbd417134 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:57:22.399868 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-257d48e9-7ec2-47ab-891a-b591aea314d6 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e5a000087fe40419ccd0d1a96fb4783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9d27da2e71d4962a53a95efc46518ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:57:22.405896 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-257d48e9-7ec2-47ab-891a-b591aea314d6 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] 10.222.0.26 "GET /compute/v2.1/servers/4f97c839-ad1c-4b04-ac59-460b0de295ed" status: 200 len: 1362 microversion: 2.1 time: 0.204677 Mar 05 02:57:22.411008 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 296/603] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:57:22 2022] GET /compute/v2.1/servers/4f97c839-ad1c-4b04-ac59-460b0de295ed => generated 1362 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 02:57:22.469562 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-2c093167-c7e5-4980-b6ab-567cbd417134 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:57:22.478651 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-2c093167-c7e5-4980-b6ab-567cbd417134 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:57:22.481212 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-2c093167-c7e5-4980-b6ab-567cbd417134 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:57:22.488450 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-2c093167-c7e5-4980-b6ab-567cbd417134 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] 10.222.0.26 "GET /compute/v2.1/servers/1b31d7bf-888c-45a2-bc3a-e7077ad3a96d" status: 200 len: 1742 microversion: 2.20 time: 0.212386 Mar 05 02:57:22.489109 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 308/604] 10.222.0.26 () {60 vars in 1276 bytes} [Sat Mar 5 02:57:22 2022] GET /compute/v2.1/servers/1b31d7bf-888c-45a2-bc3a-e7077ad3a96d => generated 1742 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 05 02:57:22.783686 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [req-acb55b8c-20d5-4b2a-9e33-e968dbbc6811 req-870157e3-f74a-4bb5-99b1-5f335549cca3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f97c839-ad1c-4b04-ac59-460b0de295ed", "name": "network-vif-plugged", "status": "completed", "tag": "00972e01-aaaf-4d40-a722-75829a58b00f"}]} {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 02:57:22.792562 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [req-acb55b8c-20d5-4b2a-9e33-e968dbbc6811 req-870157e3-f74a-4bb5-99b1-5f335549cca3 service nova] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:57:22.794447 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [req-acb55b8c-20d5-4b2a-9e33-e968dbbc6811 req-870157e3-f74a-4bb5-99b1-5f335549cca3 service nova] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:57:22.810247 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.compute.server_external_events [req-acb55b8c-20d5-4b2a-9e33-e968dbbc6811 req-870157e3-f74a-4bb5-99b1-5f335549cca3 service nova] Creating event network-vif-plugged:00972e01-aaaf-4d40-a722-75829a58b00f for instance 4f97c839-ad1c-4b04-ac59-460b0de295ed on hv-cinder-82725 Mar 05 02:57:22.816161 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [req-acb55b8c-20d5-4b2a-9e33-e968dbbc6811 req-870157e3-f74a-4bb5-99b1-5f335549cca3 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036454 Mar 05 02:57:22.816912 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 297/605] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Mar 5 02:57:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 02:57:23.423431 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-17768895-b7c9-4e81-8369-e901a9de5357 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:57:23.424868 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-17768895-b7c9-4e81-8369-e901a9de5357 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] [instance: 4f97c839-ad1c-4b04-ac59-460b0de295ed] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:57:23.432946 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-17768895-b7c9-4e81-8369-e901a9de5357 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:57:23.433519 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-17768895-b7c9-4e81-8369-e901a9de5357 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:57:23.434405 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-17768895-b7c9-4e81-8369-e901a9de5357 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:57:23.435059 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-17768895-b7c9-4e81-8369-e901a9de5357 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:57:23.510408 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-e69cd006-1138-44c1-a551-95972aa717a0 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:57:23.511064 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-e69cd006-1138-44c1-a551-95972aa717a0 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] [instance: 1b31d7bf-888c-45a2-bc3a-e7077ad3a96d] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:57:23.519333 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-e69cd006-1138-44c1-a551-95972aa717a0 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:57:23.519783 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-e69cd006-1138-44c1-a551-95972aa717a0 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:57:23.520903 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-e69cd006-1138-44c1-a551-95972aa717a0 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:57:23.522939 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-e69cd006-1138-44c1-a551-95972aa717a0 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:57:23.611567 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-17768895-b7c9-4e81-8369-e901a9de5357 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e5a000087fe40419ccd0d1a96fb4783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9d27da2e71d4962a53a95efc46518ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:57:23.624970 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-17768895-b7c9-4e81-8369-e901a9de5357 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] 10.222.0.26 "GET /compute/v2.1/servers/4f97c839-ad1c-4b04-ac59-460b0de295ed" status: 200 len: 1362 microversion: 2.1 time: 0.205977 Mar 05 02:57:23.629362 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 309/606] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:57:23 2022] GET /compute/v2.1/servers/4f97c839-ad1c-4b04-ac59-460b0de295ed => generated 1362 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 02:57:23.703689 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-e69cd006-1138-44c1-a551-95972aa717a0 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:57:23.712684 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-e69cd006-1138-44c1-a551-95972aa717a0 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:57:23.714363 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-e69cd006-1138-44c1-a551-95972aa717a0 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:57:23.715721 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-e69cd006-1138-44c1-a551-95972aa717a0 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] 10.222.0.26 "GET /compute/v2.1/servers/1b31d7bf-888c-45a2-bc3a-e7077ad3a96d" status: 200 len: 1737 microversion: 2.20 time: 0.211319 Mar 05 02:57:23.716280 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 298/607] 10.222.0.26 () {60 vars in 1276 bytes} [Sat Mar 5 02:57:23 2022] GET /compute/v2.1/servers/1b31d7bf-888c-45a2-bc3a-e7077ad3a96d => generated 1737 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 02:57:24.643336 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-84dfcf15-2d0e-44f5-bc14-8b03113e8f45 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:57:24.644678 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-84dfcf15-2d0e-44f5-bc14-8b03113e8f45 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] [instance: 4f97c839-ad1c-4b04-ac59-460b0de295ed] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:57:24.651493 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-84dfcf15-2d0e-44f5-bc14-8b03113e8f45 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:57:24.652211 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-84dfcf15-2d0e-44f5-bc14-8b03113e8f45 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:57:24.652988 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-84dfcf15-2d0e-44f5-bc14-8b03113e8f45 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:57:24.653422 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-84dfcf15-2d0e-44f5-bc14-8b03113e8f45 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:57:24.734885 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-b07fa91d-80da-4fd7-82f5-2bda725beb89 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:57:24.736720 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-b07fa91d-80da-4fd7-82f5-2bda725beb89 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] [instance: 1b31d7bf-888c-45a2-bc3a-e7077ad3a96d] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:57:24.748129 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-b07fa91d-80da-4fd7-82f5-2bda725beb89 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:57:24.748737 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-b07fa91d-80da-4fd7-82f5-2bda725beb89 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:57:24.749769 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-b07fa91d-80da-4fd7-82f5-2bda725beb89 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:57:24.750311 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-b07fa91d-80da-4fd7-82f5-2bda725beb89 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:57:24.840141 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-84dfcf15-2d0e-44f5-bc14-8b03113e8f45 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e5a000087fe40419ccd0d1a96fb4783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9d27da2e71d4962a53a95efc46518ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:57:24.852334 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-84dfcf15-2d0e-44f5-bc14-8b03113e8f45 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] 10.222.0.26 "GET /compute/v2.1/servers/4f97c839-ad1c-4b04-ac59-460b0de295ed" status: 200 len: 1549 microversion: 2.1 time: 0.212856 Mar 05 02:57:24.852928 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 310/608] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:57:24 2022] GET /compute/v2.1/servers/4f97c839-ad1c-4b04-ac59-460b0de295ed => generated 1549 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 02:57:24.858100 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [req-735eeb47-d273-4c0b-8861-b85bcd2ce43e req-7d13ece1-54a0-420a-b188-cd58897ff701 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b31d7bf-888c-45a2-bc3a-e7077ad3a96d", "name": "network-vif-plugged", "status": "completed", "tag": "72f8e9b7-28cd-4b80-be32-d7f04625063d"}]} {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 02:57:24.872541 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [req-735eeb47-d273-4c0b-8861-b85bcd2ce43e req-7d13ece1-54a0-420a-b188-cd58897ff701 service nova] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:57:24.873059 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [req-735eeb47-d273-4c0b-8861-b85bcd2ce43e req-7d13ece1-54a0-420a-b188-cd58897ff701 service nova] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:57:24.890428 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.compute.server_external_events [req-735eeb47-d273-4c0b-8861-b85bcd2ce43e req-7d13ece1-54a0-420a-b188-cd58897ff701 service nova] Creating event network-vif-plugged:72f8e9b7-28cd-4b80-be32-d7f04625063d for instance 1b31d7bf-888c-45a2-bc3a-e7077ad3a96d on hv-cinder-82725 Mar 05 02:57:24.899742 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [req-735eeb47-d273-4c0b-8861-b85bcd2ce43e req-7d13ece1-54a0-420a-b188-cd58897ff701 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044997 Mar 05 02:57:24.900495 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 311/609] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Mar 5 02:57:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 02:57:24.905487 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-88b05eac-475e-46bb-a363-032fc0ae8154 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:57:24.906090 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-88b05eac-475e-46bb-a363-032fc0ae8154 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] [instance: 4f97c839-ad1c-4b04-ac59-460b0de295ed] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:57:24.916873 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-88b05eac-475e-46bb-a363-032fc0ae8154 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:57:24.917336 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-88b05eac-475e-46bb-a363-032fc0ae8154 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:57:24.918175 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-88b05eac-475e-46bb-a363-032fc0ae8154 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:57:24.918618 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-88b05eac-475e-46bb-a363-032fc0ae8154 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:57:24.927409 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-b07fa91d-80da-4fd7-82f5-2bda725beb89 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:57:24.935385 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-b07fa91d-80da-4fd7-82f5-2bda725beb89 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:57:24.937064 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-b07fa91d-80da-4fd7-82f5-2bda725beb89 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:57:24.938270 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-b07fa91d-80da-4fd7-82f5-2bda725beb89 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] 10.222.0.26 "GET /compute/v2.1/servers/1b31d7bf-888c-45a2-bc3a-e7077ad3a96d" status: 200 len: 1737 microversion: 2.20 time: 0.207969 Mar 05 02:57:24.939291 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 299/610] 10.222.0.26 () {60 vars in 1276 bytes} [Sat Mar 5 02:57:24 2022] GET /compute/v2.1/servers/1b31d7bf-888c-45a2-bc3a-e7077ad3a96d => generated 1737 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 05 02:57:25.019434 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-88b05eac-475e-46bb-a363-032fc0ae8154 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] 10.222.0.26 "GET /compute/v2.1/servers/4f97c839-ad1c-4b04-ac59-460b0de295ed/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.117172 Mar 05 02:57:25.021539 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 312/611] 10.222.0.26 () {58 vars in 1274 bytes} [Sat Mar 5 02:57:24 2022] GET /compute/v2.1/servers/4f97c839-ad1c-4b04-ac59-460b0de295ed/os-interface => generated 285 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 02:57:25.957085 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-b577b20b-a0da-4e5d-a4dd-2d139276bb00 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:57:25.957614 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-b577b20b-a0da-4e5d-a4dd-2d139276bb00 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] [instance: 1b31d7bf-888c-45a2-bc3a-e7077ad3a96d] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:57:25.963882 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-b577b20b-a0da-4e5d-a4dd-2d139276bb00 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:57:25.964341 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-b577b20b-a0da-4e5d-a4dd-2d139276bb00 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:57:25.965117 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-b577b20b-a0da-4e5d-a4dd-2d139276bb00 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:57:25.965723 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-b577b20b-a0da-4e5d-a4dd-2d139276bb00 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:57:26.177540 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-b577b20b-a0da-4e5d-a4dd-2d139276bb00 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:57:26.191231 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-b577b20b-a0da-4e5d-a4dd-2d139276bb00 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:57:26.192817 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-b577b20b-a0da-4e5d-a4dd-2d139276bb00 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:57:26.194031 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-b577b20b-a0da-4e5d-a4dd-2d139276bb00 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] 10.222.0.26 "GET /compute/v2.1/servers/1b31d7bf-888c-45a2-bc3a-e7077ad3a96d" status: 200 len: 1737 microversion: 2.20 time: 0.241442 Mar 05 02:57:26.194819 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 300/612] 10.222.0.26 () {60 vars in 1276 bytes} [Sat Mar 5 02:57:25 2022] GET /compute/v2.1/servers/1b31d7bf-888c-45a2-bc3a-e7077ad3a96d => generated 1737 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 05 02:57:26.566299 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [req-441ad97e-b414-480c-a91f-00ca01d10c78 req-161b51d7-5d2a-4618-a8b4-c42fea596177 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4f97c839-ad1c-4b04-ac59-460b0de295ed", "tag": "00972e01-aaaf-4d40-a722-75829a58b00f"}]} {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 02:57:26.580517 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [req-441ad97e-b414-480c-a91f-00ca01d10c78 req-161b51d7-5d2a-4618-a8b4-c42fea596177 service nova] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:57:26.581259 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [req-441ad97e-b414-480c-a91f-00ca01d10c78 req-161b51d7-5d2a-4618-a8b4-c42fea596177 service nova] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:57:26.595273 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.compute.server_external_events [req-441ad97e-b414-480c-a91f-00ca01d10c78 req-161b51d7-5d2a-4618-a8b4-c42fea596177 service nova] Creating event network-changed:00972e01-aaaf-4d40-a722-75829a58b00f for instance 4f97c839-ad1c-4b04-ac59-460b0de295ed on hv-cinder-82725 Mar 05 02:57:26.602224 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [req-441ad97e-b414-480c-a91f-00ca01d10c78 req-161b51d7-5d2a-4618-a8b4-c42fea596177 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.134449 Mar 05 02:57:26.602819 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 313/613] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Mar 5 02:57:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 02:57:27.212572 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-10c70ed2-1ed3-4700-8e6c-0fdc961f0afe tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:57:27.213890 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-10c70ed2-1ed3-4700-8e6c-0fdc961f0afe tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] [instance: 1b31d7bf-888c-45a2-bc3a-e7077ad3a96d] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:57:27.221491 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-10c70ed2-1ed3-4700-8e6c-0fdc961f0afe tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:57:27.224247 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-10c70ed2-1ed3-4700-8e6c-0fdc961f0afe tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:57:27.225263 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-10c70ed2-1ed3-4700-8e6c-0fdc961f0afe tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:57:27.225772 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-10c70ed2-1ed3-4700-8e6c-0fdc961f0afe tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:57:27.414118 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-10c70ed2-1ed3-4700-8e6c-0fdc961f0afe tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:57:27.427318 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-10c70ed2-1ed3-4700-8e6c-0fdc961f0afe tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:57:27.430951 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-10c70ed2-1ed3-4700-8e6c-0fdc961f0afe tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:57:27.432493 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-10c70ed2-1ed3-4700-8e6c-0fdc961f0afe tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] 10.222.0.26 "GET /compute/v2.1/servers/1b31d7bf-888c-45a2-bc3a-e7077ad3a96d" status: 200 len: 1737 microversion: 2.20 time: 0.224144 Mar 05 02:57:27.433409 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 301/614] 10.222.0.26 () {60 vars in 1276 bytes} [Sat Mar 5 02:57:27 2022] GET /compute/v2.1/servers/1b31d7bf-888c-45a2-bc3a-e7077ad3a96d => generated 1737 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 02:57:28.452263 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-4642dade-7bb9-41bd-a30f-a4db09061c8c tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:57:28.452954 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-4642dade-7bb9-41bd-a30f-a4db09061c8c tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] [instance: 1b31d7bf-888c-45a2-bc3a-e7077ad3a96d] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:57:28.459923 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-4642dade-7bb9-41bd-a30f-a4db09061c8c tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:57:28.460628 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-4642dade-7bb9-41bd-a30f-a4db09061c8c tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:57:28.461637 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-4642dade-7bb9-41bd-a30f-a4db09061c8c tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:57:28.462293 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-4642dade-7bb9-41bd-a30f-a4db09061c8c tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:57:28.619073 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-4642dade-7bb9-41bd-a30f-a4db09061c8c tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:57:28.627797 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-4642dade-7bb9-41bd-a30f-a4db09061c8c tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:57:28.629308 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-4642dade-7bb9-41bd-a30f-a4db09061c8c tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:57:28.630522 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-4642dade-7bb9-41bd-a30f-a4db09061c8c tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] 10.222.0.26 "GET /compute/v2.1/servers/1b31d7bf-888c-45a2-bc3a-e7077ad3a96d" status: 200 len: 1737 microversion: 2.20 time: 0.182519 Mar 05 02:57:28.631120 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 314/615] 10.222.0.26 () {60 vars in 1276 bytes} [Sat Mar 5 02:57:28 2022] GET /compute/v2.1/servers/1b31d7bf-888c-45a2-bc3a-e7077ad3a96d => generated 1737 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 02:57:29.650018 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-b50b9c28-6a66-422f-ae99-a8471bea1e1a tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:57:29.651006 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-b50b9c28-6a66-422f-ae99-a8471bea1e1a tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] [instance: 1b31d7bf-888c-45a2-bc3a-e7077ad3a96d] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:57:29.657074 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-b50b9c28-6a66-422f-ae99-a8471bea1e1a tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:57:29.657528 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-b50b9c28-6a66-422f-ae99-a8471bea1e1a tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:57:29.658528 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-b50b9c28-6a66-422f-ae99-a8471bea1e1a tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:57:29.659053 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-b50b9c28-6a66-422f-ae99-a8471bea1e1a tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:57:29.815896 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-b50b9c28-6a66-422f-ae99-a8471bea1e1a tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:57:29.824452 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-b50b9c28-6a66-422f-ae99-a8471bea1e1a tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:57:29.826103 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-b50b9c28-6a66-422f-ae99-a8471bea1e1a tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:57:29.827401 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-b50b9c28-6a66-422f-ae99-a8471bea1e1a tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] 10.222.0.26 "GET /compute/v2.1/servers/1b31d7bf-888c-45a2-bc3a-e7077ad3a96d" status: 200 len: 1737 microversion: 2.20 time: 0.181420 Mar 05 02:57:29.828231 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 302/616] 10.222.0.26 () {60 vars in 1276 bytes} [Sat Mar 5 02:57:29 2022] GET /compute/v2.1/servers/1b31d7bf-888c-45a2-bc3a-e7077ad3a96d => generated 1737 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 02:57:30.846053 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-3557e7d4-bfea-4766-bbf1-629733c7c0c6 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:57:30.846687 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-3557e7d4-bfea-4766-bbf1-629733c7c0c6 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] [instance: 1b31d7bf-888c-45a2-bc3a-e7077ad3a96d] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:57:30.853781 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-3557e7d4-bfea-4766-bbf1-629733c7c0c6 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:57:30.853781 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-3557e7d4-bfea-4766-bbf1-629733c7c0c6 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:57:30.854910 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-3557e7d4-bfea-4766-bbf1-629733c7c0c6 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:57:30.855422 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-3557e7d4-bfea-4766-bbf1-629733c7c0c6 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:57:31.001150 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-3557e7d4-bfea-4766-bbf1-629733c7c0c6 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:57:31.009480 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-3557e7d4-bfea-4766-bbf1-629733c7c0c6 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:57:31.011054 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-3557e7d4-bfea-4766-bbf1-629733c7c0c6 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:57:31.012220 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-3557e7d4-bfea-4766-bbf1-629733c7c0c6 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] 10.222.0.26 "GET /compute/v2.1/servers/1b31d7bf-888c-45a2-bc3a-e7077ad3a96d" status: 200 len: 1737 microversion: 2.20 time: 0.171124 Mar 05 02:57:31.014359 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 315/617] 10.222.0.26 () {60 vars in 1276 bytes} [Sat Mar 5 02:57:30 2022] GET /compute/v2.1/servers/1b31d7bf-888c-45a2-bc3a-e7077ad3a96d => generated 1737 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 02:57:32.032559 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-d7f02b85-eaa1-45b3-bda2-78510cc085ee tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:57:32.033275 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-d7f02b85-eaa1-45b3-bda2-78510cc085ee tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] [instance: 1b31d7bf-888c-45a2-bc3a-e7077ad3a96d] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:57:32.039869 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-d7f02b85-eaa1-45b3-bda2-78510cc085ee tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:57:32.040395 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-d7f02b85-eaa1-45b3-bda2-78510cc085ee tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:57:32.041462 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-d7f02b85-eaa1-45b3-bda2-78510cc085ee tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:57:32.042178 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-d7f02b85-eaa1-45b3-bda2-78510cc085ee tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:57:32.175637 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-d7f02b85-eaa1-45b3-bda2-78510cc085ee tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:57:32.183413 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-d7f02b85-eaa1-45b3-bda2-78510cc085ee tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:57:32.184911 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-d7f02b85-eaa1-45b3-bda2-78510cc085ee tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:57:32.186098 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-d7f02b85-eaa1-45b3-bda2-78510cc085ee tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] 10.222.0.26 "GET /compute/v2.1/servers/1b31d7bf-888c-45a2-bc3a-e7077ad3a96d" status: 200 len: 1737 microversion: 2.20 time: 0.157767 Mar 05 02:57:32.186653 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 303/618] 10.222.0.26 () {60 vars in 1276 bytes} [Sat Mar 5 02:57:32 2022] GET /compute/v2.1/servers/1b31d7bf-888c-45a2-bc3a-e7077ad3a96d => generated 1737 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 02:57:33.206895 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-733d93b8-4fc0-439d-8591-2843f587c06c tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:57:33.207509 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-733d93b8-4fc0-439d-8591-2843f587c06c tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] [instance: 1b31d7bf-888c-45a2-bc3a-e7077ad3a96d] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:57:33.213779 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-733d93b8-4fc0-439d-8591-2843f587c06c tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:57:33.214277 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-733d93b8-4fc0-439d-8591-2843f587c06c tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:57:33.215089 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-733d93b8-4fc0-439d-8591-2843f587c06c tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:57:33.215578 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-733d93b8-4fc0-439d-8591-2843f587c06c tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:57:33.348092 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-733d93b8-4fc0-439d-8591-2843f587c06c tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:57:33.356002 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-733d93b8-4fc0-439d-8591-2843f587c06c tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:57:33.357512 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-733d93b8-4fc0-439d-8591-2843f587c06c tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:57:33.358714 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-733d93b8-4fc0-439d-8591-2843f587c06c tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] 10.222.0.26 "GET /compute/v2.1/servers/1b31d7bf-888c-45a2-bc3a-e7077ad3a96d" status: 200 len: 1719 microversion: 2.20 time: 0.156756 Mar 05 02:57:33.359283 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 316/619] 10.222.0.26 () {60 vars in 1276 bytes} [Sat Mar 5 02:57:33 2022] GET /compute/v2.1/servers/1b31d7bf-888c-45a2-bc3a-e7077ad3a96d => generated 1719 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 02:57:34.377836 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-62675595-e464-4b1d-b41b-ceb6bf997b46 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:57:34.378484 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-62675595-e464-4b1d-b41b-ceb6bf997b46 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] [instance: 1b31d7bf-888c-45a2-bc3a-e7077ad3a96d] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:57:34.384748 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-62675595-e464-4b1d-b41b-ceb6bf997b46 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:57:34.385200 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-62675595-e464-4b1d-b41b-ceb6bf997b46 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:57:34.385977 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-62675595-e464-4b1d-b41b-ceb6bf997b46 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:57:34.386457 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-62675595-e464-4b1d-b41b-ceb6bf997b46 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:57:34.517798 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-62675595-e464-4b1d-b41b-ceb6bf997b46 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:57:34.525594 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-62675595-e464-4b1d-b41b-ceb6bf997b46 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:57:34.527110 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-62675595-e464-4b1d-b41b-ceb6bf997b46 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:57:34.528255 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-62675595-e464-4b1d-b41b-ceb6bf997b46 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] 10.222.0.26 "GET /compute/v2.1/servers/1b31d7bf-888c-45a2-bc3a-e7077ad3a96d" status: 200 len: 1719 microversion: 2.20 time: 0.154884 Mar 05 02:57:34.528816 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 304/620] 10.222.0.26 () {60 vars in 1276 bytes} [Sat Mar 5 02:57:34 2022] GET /compute/v2.1/servers/1b31d7bf-888c-45a2-bc3a-e7077ad3a96d => generated 1719 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 02:57:35.270319 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-989e9a7d-d8e8-4650-b328-e9ed5a54f8cb tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 02:57:35.270931 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-989e9a7d-d8e8-4650-b328-e9ed5a54f8cb tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] [instance: ca6cb405-f00a-4fcf-9147-824793f35ebf] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:57:35.277377 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-989e9a7d-d8e8-4650-b328-e9ed5a54f8cb tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:57:35.277826 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-989e9a7d-d8e8-4650-b328-e9ed5a54f8cb tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:57:35.278620 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-989e9a7d-d8e8-4650-b328-e9ed5a54f8cb tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:57:35.279059 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-989e9a7d-d8e8-4650-b328-e9ed5a54f8cb tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:57:35.301389 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.objects.instance [None req-989e9a7d-d8e8-4650-b328-e9ed5a54f8cb tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] Lazy-loading 'flavor' on Instance uuid ca6cb405-f00a-4fcf-9147-824793f35ebf {{(pid=123545) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 05 02:57:35.370404 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-989e9a7d-d8e8-4650-b328-e9ed5a54f8cb tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] 10.222.0.26 "POST /compute/v2.1/servers/ca6cb405-f00a-4fcf-9147-824793f35ebf/action" status: 202 len: 0 microversion: 2.1 time: 0.104138 Mar 05 02:57:35.370988 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 317/621] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Mar 5 02:57:35 2022] POST /compute/v2.1/servers/ca6cb405-f00a-4fcf-9147-824793f35ebf/action => generated 0 bytes in 106 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 05 02:57:35.380171 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-f4f8b4ee-a828-4cdc-920b-5a4d8d57ad5a tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:57:35.380813 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-f4f8b4ee-a828-4cdc-920b-5a4d8d57ad5a tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] [instance: ca6cb405-f00a-4fcf-9147-824793f35ebf] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:57:35.387110 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-f4f8b4ee-a828-4cdc-920b-5a4d8d57ad5a tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:57:35.387554 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-f4f8b4ee-a828-4cdc-920b-5a4d8d57ad5a tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:57:35.388399 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-f4f8b4ee-a828-4cdc-920b-5a4d8d57ad5a tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:57:35.388903 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-f4f8b4ee-a828-4cdc-920b-5a4d8d57ad5a tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:57:35.521890 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-f4f8b4ee-a828-4cdc-920b-5a4d8d57ad5a tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c68b816379942e282577e3d8d624ae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47835ba5de1a42cc94c09b33a187868a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:57:35.529102 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-f4f8b4ee-a828-4cdc-920b-5a4d8d57ad5a tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] 10.222.0.26 "GET /compute/v2.1/servers/ca6cb405-f00a-4fcf-9147-824793f35ebf" status: 200 len: 1569 microversion: 2.1 time: 0.153545 Mar 05 02:57:35.529675 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 305/622] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:57:35 2022] GET /compute/v2.1/servers/ca6cb405-f00a-4fcf-9147-824793f35ebf => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 02:57:35.547647 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-13dd432f-7cc3-4b19-808c-ad2af031d707 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:57:35.549062 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-13dd432f-7cc3-4b19-808c-ad2af031d707 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] [instance: 1b31d7bf-888c-45a2-bc3a-e7077ad3a96d] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:57:35.554860 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-13dd432f-7cc3-4b19-808c-ad2af031d707 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:57:35.555310 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-13dd432f-7cc3-4b19-808c-ad2af031d707 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:57:35.556086 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-13dd432f-7cc3-4b19-808c-ad2af031d707 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:57:35.556525 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-13dd432f-7cc3-4b19-808c-ad2af031d707 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:57:35.689891 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-13dd432f-7cc3-4b19-808c-ad2af031d707 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:57:35.697437 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-13dd432f-7cc3-4b19-808c-ad2af031d707 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:57:35.698950 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-13dd432f-7cc3-4b19-808c-ad2af031d707 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:57:35.700088 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-13dd432f-7cc3-4b19-808c-ad2af031d707 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] 10.222.0.26 "GET /compute/v2.1/servers/1b31d7bf-888c-45a2-bc3a-e7077ad3a96d" status: 200 len: 1662 microversion: 2.20 time: 0.156688 Mar 05 02:57:35.700643 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 318/623] 10.222.0.26 () {60 vars in 1276 bytes} [Sat Mar 5 02:57:35 2022] GET /compute/v2.1/servers/1b31d7bf-888c-45a2-bc3a-e7077ad3a96d => generated 1662 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 02:57:35.717817 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-aff1c341-ce8b-434c-a640-bc0bbc82c0fe tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a91f3b64-fe5a-4062-b514-f9b42dd989e2"}} {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 02:57:35.718924 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-aff1c341-ce8b-434c-a640-bc0bbc82c0fe tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] [instance: 1b31d7bf-888c-45a2-bc3a-e7077ad3a96d] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:57:35.725355 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-aff1c341-ce8b-434c-a640-bc0bbc82c0fe tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:57:35.725800 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-aff1c341-ce8b-434c-a640-bc0bbc82c0fe tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:57:35.726598 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-aff1c341-ce8b-434c-a640-bc0bbc82c0fe tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:57:35.727029 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-aff1c341-ce8b-434c-a640-bc0bbc82c0fe tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:57:35.978398 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-aff1c341-ce8b-434c-a640-bc0bbc82c0fe tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] 10.222.0.26 "POST /compute/v2.1/servers/1b31d7bf-888c-45a2-bc3a-e7077ad3a96d/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.264158 Mar 05 02:57:35.978994 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 306/624] 10.222.0.26 () {62 vars in 1363 bytes} [Sat Mar 5 02:57:35 2022] POST /compute/v2.1/servers/1b31d7bf-888c-45a2-bc3a-e7077ad3a96d/os-volume_attachments => generated 188 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 05 02:57:36.089381 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-7e37b54f-cbcd-4cd7-933b-bb71df7c177e tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:57:36.089880 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-7e37b54f-cbcd-4cd7-933b-bb71df7c177e tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] [instance: 1b31d7bf-888c-45a2-bc3a-e7077ad3a96d] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:57:36.095693 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-7e37b54f-cbcd-4cd7-933b-bb71df7c177e tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:57:36.096153 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-7e37b54f-cbcd-4cd7-933b-bb71df7c177e tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:57:36.096958 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-7e37b54f-cbcd-4cd7-933b-bb71df7c177e tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:57:36.097400 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-7e37b54f-cbcd-4cd7-933b-bb71df7c177e tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:57:36.325754 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-7e37b54f-cbcd-4cd7-933b-bb71df7c177e tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] 10.222.0.26 "DELETE /compute/v2.1/servers/1b31d7bf-888c-45a2-bc3a-e7077ad3a96d/os-volume_attachments/a91f3b64-fe5a-4062-b514-f9b42dd989e2" status: 202 len: 0 microversion: 2.20 time: 0.240208 Mar 05 02:57:36.326585 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 319/625] 10.222.0.26 () {60 vars in 1456 bytes} [Sat Mar 5 02:57:36 2022] DELETE /compute/v2.1/servers/1b31d7bf-888c-45a2-bc3a-e7077ad3a96d/os-volume_attachments/a91f3b64-fe5a-4062-b514-f9b42dd989e2 => generated 0 bytes in 242 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Mar 05 02:57:36.386646 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-f60ea5eb-41e9-4c00-9b89-72e64b476017 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 02:57:36.387320 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-f60ea5eb-41e9-4c00-9b89-72e64b476017 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] [instance: 1b31d7bf-888c-45a2-bc3a-e7077ad3a96d] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:57:36.394243 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-f60ea5eb-41e9-4c00-9b89-72e64b476017 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:57:36.394692 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-f60ea5eb-41e9-4c00-9b89-72e64b476017 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:57:36.395457 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-f60ea5eb-41e9-4c00-9b89-72e64b476017 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:57:36.395889 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-f60ea5eb-41e9-4c00-9b89-72e64b476017 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:57:36.497461 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [req-58b132b3-0a01-4e09-9522-74702e5f2969 req-d969f1f9-471e-4f9b-a97a-79a0dc419952 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b31d7bf-888c-45a2-bc3a-e7077ad3a96d", "name": "network-vif-unplugged", "status": "completed", "tag": "72f8e9b7-28cd-4b80-be32-d7f04625063d"}]} {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 02:57:36.507890 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [req-58b132b3-0a01-4e09-9522-74702e5f2969 req-d969f1f9-471e-4f9b-a97a-79a0dc419952 service nova] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:57:36.508794 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [req-58b132b3-0a01-4e09-9522-74702e5f2969 req-d969f1f9-471e-4f9b-a97a-79a0dc419952 service nova] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:57:36.519592 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.compute.server_external_events [req-58b132b3-0a01-4e09-9522-74702e5f2969 req-d969f1f9-471e-4f9b-a97a-79a0dc419952 service nova] Unable to find a host for instance 1b31d7bf-888c-45a2-bc3a-e7077ad3a96d. Dropping event network-vif-unplugged {{(pid=123545) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Mar 05 02:57:36.520470 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [req-58b132b3-0a01-4e09-9522-74702e5f2969 req-d969f1f9-471e-4f9b-a97a-79a0dc419952 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.101077 Mar 05 02:57:36.521067 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 320/626] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Mar 5 02:57:36 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 102 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Mar 05 02:57:36.540068 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-f60ea5eb-41e9-4c00-9b89-72e64b476017 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] 10.222.0.26 "POST /compute/v2.1/servers/1b31d7bf-888c-45a2-bc3a-e7077ad3a96d/action" status: 202 len: 0 microversion: 2.20 time: 0.157417 Mar 05 02:57:36.542428 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 307/627] 10.222.0.26 () {62 vars in 1318 bytes} [Sat Mar 5 02:57:36 2022] POST /compute/v2.1/servers/1b31d7bf-888c-45a2-bc3a-e7077ad3a96d/action => generated 0 bytes in 160 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Mar 05 02:57:36.547551 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-06f75bcf-da25-4d66-ab3a-c68ca66b23b0 tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:57:36.548224 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-06f75bcf-da25-4d66-ab3a-c68ca66b23b0 tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] [instance: ca6cb405-f00a-4fcf-9147-824793f35ebf] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:57:36.550484 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-273bc956-7184-4f4c-b9ee-b04d67315aae tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:57:36.551098 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-273bc956-7184-4f4c-b9ee-b04d67315aae tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] [instance: 1b31d7bf-888c-45a2-bc3a-e7077ad3a96d] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:57:36.555353 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-06f75bcf-da25-4d66-ab3a-c68ca66b23b0 tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:57:36.555797 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-06f75bcf-da25-4d66-ab3a-c68ca66b23b0 tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:57:36.556606 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-06f75bcf-da25-4d66-ab3a-c68ca66b23b0 tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:57:36.557041 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-06f75bcf-da25-4d66-ab3a-c68ca66b23b0 tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:57:36.557642 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-273bc956-7184-4f4c-b9ee-b04d67315aae tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:57:36.558136 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-273bc956-7184-4f4c-b9ee-b04d67315aae tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:57:36.559456 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-273bc956-7184-4f4c-b9ee-b04d67315aae tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:57:36.559456 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-273bc956-7184-4f4c-b9ee-b04d67315aae tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:57:36.768110 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-273bc956-7184-4f4c-b9ee-b04d67315aae tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:57:36.771212 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-06f75bcf-da25-4d66-ab3a-c68ca66b23b0 tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c68b816379942e282577e3d8d624ae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47835ba5de1a42cc94c09b33a187868a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:57:36.778149 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-273bc956-7184-4f4c-b9ee-b04d67315aae tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:57:36.779659 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-273bc956-7184-4f4c-b9ee-b04d67315aae tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:57:36.780243 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-06f75bcf-da25-4d66-ab3a-c68ca66b23b0 tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] 10.222.0.26 "GET /compute/v2.1/servers/ca6cb405-f00a-4fcf-9147-824793f35ebf" status: 200 len: 1569 microversion: 2.1 time: 0.237050 Mar 05 02:57:36.780926 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 321/628] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:57:36 2022] GET /compute/v2.1/servers/ca6cb405-f00a-4fcf-9147-824793f35ebf => generated 1569 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 02:57:36.781371 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-273bc956-7184-4f4c-b9ee-b04d67315aae tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] 10.222.0.26 "GET /compute/v2.1/servers/1b31d7bf-888c-45a2-bc3a-e7077ad3a96d" status: 200 len: 1670 microversion: 2.20 time: 0.234933 Mar 05 02:57:36.782453 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 308/629] 10.222.0.26 () {60 vars in 1276 bytes} [Sat Mar 5 02:57:36 2022] GET /compute/v2.1/servers/1b31d7bf-888c-45a2-bc3a-e7077ad3a96d => generated 1670 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 05 02:57:37.798083 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-ab4e9ae8-e21a-40cb-a036-44300f667baf tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:57:37.799986 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-ab4e9ae8-e21a-40cb-a036-44300f667baf tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] [instance: ca6cb405-f00a-4fcf-9147-824793f35ebf] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:57:37.801388 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-992dd343-ecd8-4705-b141-bf01640bf628 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:57:37.802030 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-992dd343-ecd8-4705-b141-bf01640bf628 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] [instance: 1b31d7bf-888c-45a2-bc3a-e7077ad3a96d] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:57:37.805805 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-ab4e9ae8-e21a-40cb-a036-44300f667baf tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:57:37.806291 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-ab4e9ae8-e21a-40cb-a036-44300f667baf tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:57:37.807056 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-ab4e9ae8-e21a-40cb-a036-44300f667baf tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:57:37.807485 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-ab4e9ae8-e21a-40cb-a036-44300f667baf tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:57:37.808359 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-992dd343-ecd8-4705-b141-bf01640bf628 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:57:37.808810 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-992dd343-ecd8-4705-b141-bf01640bf628 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:57:37.809578 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-992dd343-ecd8-4705-b141-bf01640bf628 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:57:37.810053 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-992dd343-ecd8-4705-b141-bf01640bf628 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:57:38.084088 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-ab4e9ae8-e21a-40cb-a036-44300f667baf tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c68b816379942e282577e3d8d624ae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47835ba5de1a42cc94c09b33a187868a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:57:38.087135 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-992dd343-ecd8-4705-b141-bf01640bf628 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:57:38.092044 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-ab4e9ae8-e21a-40cb-a036-44300f667baf tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] 10.222.0.26 "GET /compute/v2.1/servers/ca6cb405-f00a-4fcf-9147-824793f35ebf" status: 200 len: 1569 microversion: 2.1 time: 0.298026 Mar 05 02:57:38.095832 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-992dd343-ecd8-4705-b141-bf01640bf628 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:57:38.097395 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-992dd343-ecd8-4705-b141-bf01640bf628 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:57:38.098631 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-992dd343-ecd8-4705-b141-bf01640bf628 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] 10.222.0.26 "GET /compute/v2.1/servers/1b31d7bf-888c-45a2-bc3a-e7077ad3a96d" status: 200 len: 1728 microversion: 2.20 time: 0.302342 Mar 05 02:57:38.099060 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 322/630] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:57:37 2022] GET /compute/v2.1/servers/ca6cb405-f00a-4fcf-9147-824793f35ebf => generated 1569 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 02:57:38.108884 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 309/631] 10.222.0.26 () {60 vars in 1276 bytes} [Sat Mar 5 02:57:37 2022] GET /compute/v2.1/servers/1b31d7bf-888c-45a2-bc3a-e7077ad3a96d => generated 1728 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 05 02:57:39.112066 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-d4e2687a-0072-4ba5-9f3b-cd64546b3c7c tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:57:39.113669 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-d4e2687a-0072-4ba5-9f3b-cd64546b3c7c tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] [instance: ca6cb405-f00a-4fcf-9147-824793f35ebf] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:57:39.118222 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-fda52e5d-5930-4b78-9c3b-b6bc11cf27ff tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:57:39.119364 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-fda52e5d-5930-4b78-9c3b-b6bc11cf27ff tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] [instance: 1b31d7bf-888c-45a2-bc3a-e7077ad3a96d] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:57:39.120889 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-d4e2687a-0072-4ba5-9f3b-cd64546b3c7c tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:57:39.121486 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-d4e2687a-0072-4ba5-9f3b-cd64546b3c7c tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:57:39.122564 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-d4e2687a-0072-4ba5-9f3b-cd64546b3c7c tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:57:39.123099 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-d4e2687a-0072-4ba5-9f3b-cd64546b3c7c tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:57:39.125508 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-fda52e5d-5930-4b78-9c3b-b6bc11cf27ff tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:57:39.125976 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-fda52e5d-5930-4b78-9c3b-b6bc11cf27ff tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:57:39.128224 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-fda52e5d-5930-4b78-9c3b-b6bc11cf27ff tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:57:39.128224 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-fda52e5d-5930-4b78-9c3b-b6bc11cf27ff tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:57:39.324826 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-fda52e5d-5930-4b78-9c3b-b6bc11cf27ff tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:57:39.333191 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-fda52e5d-5930-4b78-9c3b-b6bc11cf27ff tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:57:39.335464 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-fda52e5d-5930-4b78-9c3b-b6bc11cf27ff tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:57:39.336756 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-fda52e5d-5930-4b78-9c3b-b6bc11cf27ff tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] 10.222.0.26 "GET /compute/v2.1/servers/1b31d7bf-888c-45a2-bc3a-e7077ad3a96d" status: 200 len: 1728 microversion: 2.20 time: 0.222302 Mar 05 02:57:39.337826 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 310/632] 10.222.0.26 () {60 vars in 1276 bytes} [Sat Mar 5 02:57:39 2022] GET /compute/v2.1/servers/1b31d7bf-888c-45a2-bc3a-e7077ad3a96d => generated 1728 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 05 02:57:39.367923 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-d4e2687a-0072-4ba5-9f3b-cd64546b3c7c tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c68b816379942e282577e3d8d624ae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47835ba5de1a42cc94c09b33a187868a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:57:39.375785 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-d4e2687a-0072-4ba5-9f3b-cd64546b3c7c tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] 10.222.0.26 "GET /compute/v2.1/servers/ca6cb405-f00a-4fcf-9147-824793f35ebf" status: 200 len: 1569 microversion: 2.1 time: 0.269262 Mar 05 02:57:39.376830 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 323/633] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:57:39 2022] GET /compute/v2.1/servers/ca6cb405-f00a-4fcf-9147-824793f35ebf => generated 1569 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 02:57:40.356066 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-0914d536-40d4-45ca-8600-6e8c60e77fd9 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:57:40.356698 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-0914d536-40d4-45ca-8600-6e8c60e77fd9 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] [instance: 1b31d7bf-888c-45a2-bc3a-e7077ad3a96d] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:57:40.363530 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-0914d536-40d4-45ca-8600-6e8c60e77fd9 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:57:40.363980 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-0914d536-40d4-45ca-8600-6e8c60e77fd9 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:57:40.364763 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-0914d536-40d4-45ca-8600-6e8c60e77fd9 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:57:40.365199 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-0914d536-40d4-45ca-8600-6e8c60e77fd9 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:57:40.393591 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-8cf48a9b-b119-4d65-9b83-3f78c3fd37b9 tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:57:40.395078 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-8cf48a9b-b119-4d65-9b83-3f78c3fd37b9 tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] [instance: ca6cb405-f00a-4fcf-9147-824793f35ebf] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:57:40.419592 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-8cf48a9b-b119-4d65-9b83-3f78c3fd37b9 tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:57:40.420440 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-8cf48a9b-b119-4d65-9b83-3f78c3fd37b9 tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:57:40.422824 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-8cf48a9b-b119-4d65-9b83-3f78c3fd37b9 tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:57:40.423552 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-8cf48a9b-b119-4d65-9b83-3f78c3fd37b9 tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:57:40.554645 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-0914d536-40d4-45ca-8600-6e8c60e77fd9 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:57:40.563768 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-0914d536-40d4-45ca-8600-6e8c60e77fd9 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:57:40.565742 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-0914d536-40d4-45ca-8600-6e8c60e77fd9 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:57:40.567147 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-0914d536-40d4-45ca-8600-6e8c60e77fd9 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] 10.222.0.26 "GET /compute/v2.1/servers/1b31d7bf-888c-45a2-bc3a-e7077ad3a96d" status: 200 len: 1728 microversion: 2.20 time: 0.215296 Mar 05 02:57:40.578559 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 311/634] 10.222.0.26 () {60 vars in 1276 bytes} [Sat Mar 5 02:57:40 2022] GET /compute/v2.1/servers/1b31d7bf-888c-45a2-bc3a-e7077ad3a96d => generated 1728 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 02:57:40.629768 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-8cf48a9b-b119-4d65-9b83-3f78c3fd37b9 tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c68b816379942e282577e3d8d624ae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47835ba5de1a42cc94c09b33a187868a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:57:40.637596 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-8cf48a9b-b119-4d65-9b83-3f78c3fd37b9 tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] 10.222.0.26 "GET /compute/v2.1/servers/ca6cb405-f00a-4fcf-9147-824793f35ebf" status: 200 len: 1569 microversion: 2.1 time: 0.248724 Mar 05 02:57:40.638356 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 324/635] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:57:40 2022] GET /compute/v2.1/servers/ca6cb405-f00a-4fcf-9147-824793f35ebf => generated 1569 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 02:57:41.584993 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-e2e77540-60d9-4135-ac32-7dbe53371c27 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:57:41.585696 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-e2e77540-60d9-4135-ac32-7dbe53371c27 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] [instance: 1b31d7bf-888c-45a2-bc3a-e7077ad3a96d] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:57:41.592369 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-e2e77540-60d9-4135-ac32-7dbe53371c27 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:57:41.592828 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-e2e77540-60d9-4135-ac32-7dbe53371c27 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:57:41.593611 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-e2e77540-60d9-4135-ac32-7dbe53371c27 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:57:41.594072 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-e2e77540-60d9-4135-ac32-7dbe53371c27 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:57:41.655464 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-d5b131c9-bbcf-4012-9519-7207a4074463 tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:57:41.656332 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-d5b131c9-bbcf-4012-9519-7207a4074463 tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] [instance: ca6cb405-f00a-4fcf-9147-824793f35ebf] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:57:41.663092 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-d5b131c9-bbcf-4012-9519-7207a4074463 tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:57:41.663565 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-d5b131c9-bbcf-4012-9519-7207a4074463 tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:57:41.664354 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-d5b131c9-bbcf-4012-9519-7207a4074463 tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:57:41.664784 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-d5b131c9-bbcf-4012-9519-7207a4074463 tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:57:41.785383 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-e2e77540-60d9-4135-ac32-7dbe53371c27 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:57:41.793618 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-e2e77540-60d9-4135-ac32-7dbe53371c27 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:57:41.795169 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-e2e77540-60d9-4135-ac32-7dbe53371c27 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:57:41.798825 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-e2e77540-60d9-4135-ac32-7dbe53371c27 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] 10.222.0.26 "GET /compute/v2.1/servers/1b31d7bf-888c-45a2-bc3a-e7077ad3a96d" status: 200 len: 1728 microversion: 2.20 time: 0.216053 Mar 05 02:57:41.799443 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 312/636] 10.222.0.26 () {60 vars in 1276 bytes} [Sat Mar 5 02:57:41 2022] GET /compute/v2.1/servers/1b31d7bf-888c-45a2-bc3a-e7077ad3a96d => generated 1728 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 02:57:41.850554 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-d5b131c9-bbcf-4012-9519-7207a4074463 tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c68b816379942e282577e3d8d624ae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47835ba5de1a42cc94c09b33a187868a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:57:41.858752 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-d5b131c9-bbcf-4012-9519-7207a4074463 tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] 10.222.0.26 "GET /compute/v2.1/servers/ca6cb405-f00a-4fcf-9147-824793f35ebf" status: 200 len: 1569 microversion: 2.1 time: 0.207018 Mar 05 02:57:41.859335 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 325/637] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:57:41 2022] GET /compute/v2.1/servers/ca6cb405-f00a-4fcf-9147-824793f35ebf => generated 1569 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 02:57:42.818096 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-a5495baf-23fd-4b01-ba89-87e8a736a2de tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:57:42.818704 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-a5495baf-23fd-4b01-ba89-87e8a736a2de tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] [instance: 1b31d7bf-888c-45a2-bc3a-e7077ad3a96d] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:57:42.825063 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-a5495baf-23fd-4b01-ba89-87e8a736a2de tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:57:42.825514 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-a5495baf-23fd-4b01-ba89-87e8a736a2de tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:57:42.826333 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-a5495baf-23fd-4b01-ba89-87e8a736a2de tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:57:42.826764 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-a5495baf-23fd-4b01-ba89-87e8a736a2de tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:57:42.876107 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-b13683d0-1771-49d6-8007-0358c2608c48 tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:57:42.877510 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-b13683d0-1771-49d6-8007-0358c2608c48 tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] [instance: ca6cb405-f00a-4fcf-9147-824793f35ebf] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:57:42.884249 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-b13683d0-1771-49d6-8007-0358c2608c48 tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:57:42.885071 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-b13683d0-1771-49d6-8007-0358c2608c48 tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:57:42.886115 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-b13683d0-1771-49d6-8007-0358c2608c48 tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:57:42.886760 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-b13683d0-1771-49d6-8007-0358c2608c48 tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:57:43.004468 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-a5495baf-23fd-4b01-ba89-87e8a736a2de tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:57:43.014081 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-a5495baf-23fd-4b01-ba89-87e8a736a2de tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:57:43.015719 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-a5495baf-23fd-4b01-ba89-87e8a736a2de tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:57:43.017324 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-a5495baf-23fd-4b01-ba89-87e8a736a2de tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] 10.222.0.26 "GET /compute/v2.1/servers/1b31d7bf-888c-45a2-bc3a-e7077ad3a96d" status: 200 len: 1728 microversion: 2.20 time: 0.203340 Mar 05 02:57:43.018316 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 313/638] 10.222.0.26 () {60 vars in 1276 bytes} [Sat Mar 5 02:57:42 2022] GET /compute/v2.1/servers/1b31d7bf-888c-45a2-bc3a-e7077ad3a96d => generated 1728 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 02:57:43.083316 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-b13683d0-1771-49d6-8007-0358c2608c48 tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c68b816379942e282577e3d8d624ae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47835ba5de1a42cc94c09b33a187868a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:57:43.091732 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-b13683d0-1771-49d6-8007-0358c2608c48 tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] 10.222.0.26 "GET /compute/v2.1/servers/ca6cb405-f00a-4fcf-9147-824793f35ebf" status: 200 len: 1569 microversion: 2.1 time: 0.219219 Mar 05 02:57:43.092548 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 326/639] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:57:42 2022] GET /compute/v2.1/servers/ca6cb405-f00a-4fcf-9147-824793f35ebf => generated 1569 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 02:57:44.035820 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-c5480ff7-f258-43e2-b8b8-47745b5a16b7 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:57:44.036384 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-c5480ff7-f258-43e2-b8b8-47745b5a16b7 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] [instance: 1b31d7bf-888c-45a2-bc3a-e7077ad3a96d] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:57:44.043087 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-c5480ff7-f258-43e2-b8b8-47745b5a16b7 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:57:44.043539 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-c5480ff7-f258-43e2-b8b8-47745b5a16b7 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:57:44.044316 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-c5480ff7-f258-43e2-b8b8-47745b5a16b7 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:57:44.044759 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-c5480ff7-f258-43e2-b8b8-47745b5a16b7 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:57:44.108716 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-d7d3c212-14c6-40f8-8c24-dc877a7bded3 tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:57:44.109506 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-d7d3c212-14c6-40f8-8c24-dc877a7bded3 tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] [instance: ca6cb405-f00a-4fcf-9147-824793f35ebf] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:57:44.116491 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-d7d3c212-14c6-40f8-8c24-dc877a7bded3 tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:57:44.116949 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-d7d3c212-14c6-40f8-8c24-dc877a7bded3 tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:57:44.117738 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-d7d3c212-14c6-40f8-8c24-dc877a7bded3 tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:57:44.118202 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-d7d3c212-14c6-40f8-8c24-dc877a7bded3 tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:57:44.213130 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-c5480ff7-f258-43e2-b8b8-47745b5a16b7 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:57:44.221674 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-c5480ff7-f258-43e2-b8b8-47745b5a16b7 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:57:44.223490 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-c5480ff7-f258-43e2-b8b8-47745b5a16b7 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:57:44.224951 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-c5480ff7-f258-43e2-b8b8-47745b5a16b7 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] 10.222.0.26 "GET /compute/v2.1/servers/1b31d7bf-888c-45a2-bc3a-e7077ad3a96d" status: 200 len: 1728 microversion: 2.20 time: 0.192817 Mar 05 02:57:44.226627 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 314/640] 10.222.0.26 () {60 vars in 1276 bytes} [Sat Mar 5 02:57:44 2022] GET /compute/v2.1/servers/1b31d7bf-888c-45a2-bc3a-e7077ad3a96d => generated 1728 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 02:57:44.284584 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-d7d3c212-14c6-40f8-8c24-dc877a7bded3 tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c68b816379942e282577e3d8d624ae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47835ba5de1a42cc94c09b33a187868a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:57:44.292258 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-d7d3c212-14c6-40f8-8c24-dc877a7bded3 tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] 10.222.0.26 "GET /compute/v2.1/servers/ca6cb405-f00a-4fcf-9147-824793f35ebf" status: 200 len: 1569 microversion: 2.1 time: 0.187251 Mar 05 02:57:44.292970 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 327/641] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:57:44 2022] GET /compute/v2.1/servers/ca6cb405-f00a-4fcf-9147-824793f35ebf => generated 1569 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 02:57:45.242563 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-d0aeebb4-45fd-4d4e-b648-59661011dc48 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:57:45.243307 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-d0aeebb4-45fd-4d4e-b648-59661011dc48 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] [instance: 1b31d7bf-888c-45a2-bc3a-e7077ad3a96d] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:57:45.249632 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-d0aeebb4-45fd-4d4e-b648-59661011dc48 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:57:45.250119 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-d0aeebb4-45fd-4d4e-b648-59661011dc48 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:57:45.250899 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-d0aeebb4-45fd-4d4e-b648-59661011dc48 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:57:45.251843 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-d0aeebb4-45fd-4d4e-b648-59661011dc48 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:57:45.311981 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-edac161b-3ff6-4ab0-b6a9-aa06c8e55ea2 tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:57:45.312728 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-edac161b-3ff6-4ab0-b6a9-aa06c8e55ea2 tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] [instance: ca6cb405-f00a-4fcf-9147-824793f35ebf] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:57:45.320152 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-edac161b-3ff6-4ab0-b6a9-aa06c8e55ea2 tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:57:45.320602 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-edac161b-3ff6-4ab0-b6a9-aa06c8e55ea2 tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:57:45.321395 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-edac161b-3ff6-4ab0-b6a9-aa06c8e55ea2 tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:57:45.321833 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-edac161b-3ff6-4ab0-b6a9-aa06c8e55ea2 tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:57:45.719485 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-d0aeebb4-45fd-4d4e-b648-59661011dc48 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:57:45.729511 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-d0aeebb4-45fd-4d4e-b648-59661011dc48 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:57:45.731066 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-d0aeebb4-45fd-4d4e-b648-59661011dc48 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:57:45.732254 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-d0aeebb4-45fd-4d4e-b648-59661011dc48 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] 10.222.0.26 "GET /compute/v2.1/servers/1b31d7bf-888c-45a2-bc3a-e7077ad3a96d" status: 200 len: 1728 microversion: 2.20 time: 0.493718 Mar 05 02:57:45.733086 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 315/642] 10.222.0.26 () {60 vars in 1276 bytes} [Sat Mar 5 02:57:45 2022] GET /compute/v2.1/servers/1b31d7bf-888c-45a2-bc3a-e7077ad3a96d => generated 1728 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 02:57:45.753305 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-edac161b-3ff6-4ab0-b6a9-aa06c8e55ea2 tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c68b816379942e282577e3d8d624ae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47835ba5de1a42cc94c09b33a187868a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:57:45.763112 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-edac161b-3ff6-4ab0-b6a9-aa06c8e55ea2 tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] 10.222.0.26 "GET /compute/v2.1/servers/ca6cb405-f00a-4fcf-9147-824793f35ebf" status: 200 len: 1569 microversion: 2.1 time: 0.455799 Mar 05 02:57:45.763112 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 328/643] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:57:45 2022] GET /compute/v2.1/servers/ca6cb405-f00a-4fcf-9147-824793f35ebf => generated 1569 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 02:57:46.751865 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-5342fbf4-82a8-424c-a1fa-d86a40cc7ffd tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:57:46.753220 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-5342fbf4-82a8-424c-a1fa-d86a40cc7ffd tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] [instance: 1b31d7bf-888c-45a2-bc3a-e7077ad3a96d] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:57:46.759045 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-5342fbf4-82a8-424c-a1fa-d86a40cc7ffd tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:57:46.759490 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-5342fbf4-82a8-424c-a1fa-d86a40cc7ffd tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:57:46.760268 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-5342fbf4-82a8-424c-a1fa-d86a40cc7ffd tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:57:46.760699 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-5342fbf4-82a8-424c-a1fa-d86a40cc7ffd tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:57:46.784417 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-29a91510-3034-48c6-ba1b-a707d5e891ad tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:57:46.785089 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-29a91510-3034-48c6-ba1b-a707d5e891ad tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] [instance: ca6cb405-f00a-4fcf-9147-824793f35ebf] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:57:46.791486 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-29a91510-3034-48c6-ba1b-a707d5e891ad tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:57:46.791937 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-29a91510-3034-48c6-ba1b-a707d5e891ad tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:57:46.792726 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-29a91510-3034-48c6-ba1b-a707d5e891ad tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:57:46.793161 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-29a91510-3034-48c6-ba1b-a707d5e891ad tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:57:46.979069 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-5342fbf4-82a8-424c-a1fa-d86a40cc7ffd tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:57:46.984174 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-29a91510-3034-48c6-ba1b-a707d5e891ad tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c68b816379942e282577e3d8d624ae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47835ba5de1a42cc94c09b33a187868a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:57:46.988363 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-5342fbf4-82a8-424c-a1fa-d86a40cc7ffd tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:57:46.989900 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-5342fbf4-82a8-424c-a1fa-d86a40cc7ffd tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:57:46.991122 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-5342fbf4-82a8-424c-a1fa-d86a40cc7ffd tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] 10.222.0.26 "GET /compute/v2.1/servers/1b31d7bf-888c-45a2-bc3a-e7077ad3a96d" status: 200 len: 1728 microversion: 2.20 time: 0.243776 Mar 05 02:57:46.991861 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 316/644] 10.222.0.26 () {60 vars in 1276 bytes} [Sat Mar 5 02:57:46 2022] GET /compute/v2.1/servers/1b31d7bf-888c-45a2-bc3a-e7077ad3a96d => generated 1728 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 02:57:46.993570 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-29a91510-3034-48c6-ba1b-a707d5e891ad tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] 10.222.0.26 "GET /compute/v2.1/servers/ca6cb405-f00a-4fcf-9147-824793f35ebf" status: 200 len: 1569 microversion: 2.1 time: 0.215545 Mar 05 02:57:46.994402 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 329/645] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:57:46 2022] GET /compute/v2.1/servers/ca6cb405-f00a-4fcf-9147-824793f35ebf => generated 1569 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 02:57:48.009926 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-18538c21-830b-46ef-947b-f3bb714ae4a5 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:57:48.016286 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-a5925fc8-9420-4d00-be64-9b50881b55d6 tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:57:48.018251 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-18538c21-830b-46ef-947b-f3bb714ae4a5 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] [instance: 1b31d7bf-888c-45a2-bc3a-e7077ad3a96d] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:57:48.019269 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-a5925fc8-9420-4d00-be64-9b50881b55d6 tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] [instance: ca6cb405-f00a-4fcf-9147-824793f35ebf] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:57:48.025945 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-a5925fc8-9420-4d00-be64-9b50881b55d6 tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:57:48.026538 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-a5925fc8-9420-4d00-be64-9b50881b55d6 tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:57:48.027407 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-a5925fc8-9420-4d00-be64-9b50881b55d6 tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:57:48.027892 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-a5925fc8-9420-4d00-be64-9b50881b55d6 tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:57:48.028614 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-18538c21-830b-46ef-947b-f3bb714ae4a5 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:57:48.029059 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-18538c21-830b-46ef-947b-f3bb714ae4a5 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:57:48.030044 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-18538c21-830b-46ef-947b-f3bb714ae4a5 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:57:48.030484 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-18538c21-830b-46ef-947b-f3bb714ae4a5 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:57:48.337609 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-18538c21-830b-46ef-947b-f3bb714ae4a5 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:57:48.342937 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-a5925fc8-9420-4d00-be64-9b50881b55d6 tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c68b816379942e282577e3d8d624ae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47835ba5de1a42cc94c09b33a187868a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:57:48.346075 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-18538c21-830b-46ef-947b-f3bb714ae4a5 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:57:48.347621 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-18538c21-830b-46ef-947b-f3bb714ae4a5 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:57:48.348920 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-18538c21-830b-46ef-947b-f3bb714ae4a5 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] 10.222.0.26 "GET /compute/v2.1/servers/1b31d7bf-888c-45a2-bc3a-e7077ad3a96d" status: 200 len: 1728 microversion: 2.20 time: 0.342854 Mar 05 02:57:48.349354 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 317/646] 10.222.0.26 () {60 vars in 1276 bytes} [Sat Mar 5 02:57:48 2022] GET /compute/v2.1/servers/1b31d7bf-888c-45a2-bc3a-e7077ad3a96d => generated 1728 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 02:57:48.351285 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-a5925fc8-9420-4d00-be64-9b50881b55d6 tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] 10.222.0.26 "GET /compute/v2.1/servers/ca6cb405-f00a-4fcf-9147-824793f35ebf" status: 200 len: 1569 microversion: 2.1 time: 0.339571 Mar 05 02:57:48.351912 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 330/647] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:57:48 2022] GET /compute/v2.1/servers/ca6cb405-f00a-4fcf-9147-824793f35ebf => generated 1569 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 02:57:49.367626 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-6b10ecee-4ae9-4276-b642-4f2f5994a639 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:57:49.368235 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-6b10ecee-4ae9-4276-b642-4f2f5994a639 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] [instance: 1b31d7bf-888c-45a2-bc3a-e7077ad3a96d] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:57:49.369623 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-d771d992-651b-4553-bf9a-58b912e42834 tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:57:49.370281 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-d771d992-651b-4553-bf9a-58b912e42834 tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] [instance: ca6cb405-f00a-4fcf-9147-824793f35ebf] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:57:49.374646 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-6b10ecee-4ae9-4276-b642-4f2f5994a639 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:57:49.375113 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-6b10ecee-4ae9-4276-b642-4f2f5994a639 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:57:49.376021 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-6b10ecee-4ae9-4276-b642-4f2f5994a639 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:57:49.377096 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-6b10ecee-4ae9-4276-b642-4f2f5994a639 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:57:49.378429 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-d771d992-651b-4553-bf9a-58b912e42834 tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:57:49.378974 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-d771d992-651b-4553-bf9a-58b912e42834 tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:57:49.379783 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-d771d992-651b-4553-bf9a-58b912e42834 tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:57:49.380222 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-d771d992-651b-4553-bf9a-58b912e42834 tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:57:49.574434 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-6b10ecee-4ae9-4276-b642-4f2f5994a639 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:57:49.578460 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-d771d992-651b-4553-bf9a-58b912e42834 tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c68b816379942e282577e3d8d624ae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47835ba5de1a42cc94c09b33a187868a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:57:49.582690 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-6b10ecee-4ae9-4276-b642-4f2f5994a639 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:57:49.584211 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-6b10ecee-4ae9-4276-b642-4f2f5994a639 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:57:49.585381 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-6b10ecee-4ae9-4276-b642-4f2f5994a639 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] 10.222.0.26 "GET /compute/v2.1/servers/1b31d7bf-888c-45a2-bc3a-e7077ad3a96d" status: 200 len: 1728 microversion: 2.20 time: 0.221651 Mar 05 02:57:49.585983 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 318/648] 10.222.0.26 () {60 vars in 1276 bytes} [Sat Mar 5 02:57:49 2022] GET /compute/v2.1/servers/1b31d7bf-888c-45a2-bc3a-e7077ad3a96d => generated 1728 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 02:57:49.586459 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-d771d992-651b-4553-bf9a-58b912e42834 tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] 10.222.0.26 "GET /compute/v2.1/servers/ca6cb405-f00a-4fcf-9147-824793f35ebf" status: 200 len: 1569 microversion: 2.1 time: 0.220698 Mar 05 02:57:49.587026 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 331/649] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:57:49 2022] GET /compute/v2.1/servers/ca6cb405-f00a-4fcf-9147-824793f35ebf => generated 1569 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 02:57:50.605832 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-24d026d0-ffc8-4305-9adb-734be930157b tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:57:50.609635 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-6aced0eb-68b3-404e-ae57-808865c68e34 tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:57:50.610740 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-24d026d0-ffc8-4305-9adb-734be930157b tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] [instance: 1b31d7bf-888c-45a2-bc3a-e7077ad3a96d] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:57:50.614028 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-6aced0eb-68b3-404e-ae57-808865c68e34 tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] [instance: ca6cb405-f00a-4fcf-9147-824793f35ebf] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:57:50.620008 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-6aced0eb-68b3-404e-ae57-808865c68e34 tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:57:50.623437 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-24d026d0-ffc8-4305-9adb-734be930157b tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:57:50.623901 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-24d026d0-ffc8-4305-9adb-734be930157b tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:57:50.624690 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-24d026d0-ffc8-4305-9adb-734be930157b tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:57:50.625137 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-24d026d0-ffc8-4305-9adb-734be930157b tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:57:50.629817 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-6aced0eb-68b3-404e-ae57-808865c68e34 tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:57:50.630728 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-6aced0eb-68b3-404e-ae57-808865c68e34 tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:57:50.631174 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-6aced0eb-68b3-404e-ae57-808865c68e34 tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:57:50.842186 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-24d026d0-ffc8-4305-9adb-734be930157b tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:57:50.846511 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-6aced0eb-68b3-404e-ae57-808865c68e34 tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c68b816379942e282577e3d8d624ae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47835ba5de1a42cc94c09b33a187868a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:57:50.850098 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-24d026d0-ffc8-4305-9adb-734be930157b tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:57:50.851574 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-24d026d0-ffc8-4305-9adb-734be930157b tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:57:50.853171 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-24d026d0-ffc8-4305-9adb-734be930157b tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] 10.222.0.26 "GET /compute/v2.1/servers/1b31d7bf-888c-45a2-bc3a-e7077ad3a96d" status: 200 len: 1728 microversion: 2.20 time: 0.251231 Mar 05 02:57:50.853899 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 332/650] 10.222.0.26 () {60 vars in 1276 bytes} [Sat Mar 5 02:57:50 2022] GET /compute/v2.1/servers/1b31d7bf-888c-45a2-bc3a-e7077ad3a96d => generated 1728 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 02:57:50.854142 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-6aced0eb-68b3-404e-ae57-808865c68e34 tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] 10.222.0.26 "GET /compute/v2.1/servers/ca6cb405-f00a-4fcf-9147-824793f35ebf" status: 200 len: 1570 microversion: 2.1 time: 0.253656 Mar 05 02:57:50.854652 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 319/651] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:57:50 2022] GET /compute/v2.1/servers/ca6cb405-f00a-4fcf-9147-824793f35ebf => generated 1570 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 02:57:50.870757 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-814b0e9d-9b55-4d55-8d58-67606f371855 tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 02:57:50.871325 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-814b0e9d-9b55-4d55-8d58-67606f371855 tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] [instance: ca6cb405-f00a-4fcf-9147-824793f35ebf] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:57:50.877677 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-814b0e9d-9b55-4d55-8d58-67606f371855 tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:57:50.878158 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-814b0e9d-9b55-4d55-8d58-67606f371855 tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:57:50.878938 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-814b0e9d-9b55-4d55-8d58-67606f371855 tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:57:50.879378 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-814b0e9d-9b55-4d55-8d58-67606f371855 tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:57:50.952762 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-814b0e9d-9b55-4d55-8d58-67606f371855 tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] 10.222.0.26 "POST /compute/v2.1/servers/ca6cb405-f00a-4fcf-9147-824793f35ebf/action" status: 202 len: 0 microversion: 2.1 time: 0.085667 Mar 05 02:57:50.953385 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 333/652] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Mar 5 02:57:50 2022] POST /compute/v2.1/servers/ca6cb405-f00a-4fcf-9147-824793f35ebf/action => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 05 02:57:50.961398 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-ddb558b9-4112-49ab-8c73-c3f59f01d310 tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:57:50.962024 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-ddb558b9-4112-49ab-8c73-c3f59f01d310 tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] [instance: ca6cb405-f00a-4fcf-9147-824793f35ebf] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:57:50.967911 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-ddb558b9-4112-49ab-8c73-c3f59f01d310 tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:57:50.968439 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-ddb558b9-4112-49ab-8c73-c3f59f01d310 tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:57:50.969306 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-ddb558b9-4112-49ab-8c73-c3f59f01d310 tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:57:50.970130 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-ddb558b9-4112-49ab-8c73-c3f59f01d310 tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:57:51.151783 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-ddb558b9-4112-49ab-8c73-c3f59f01d310 tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c68b816379942e282577e3d8d624ae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47835ba5de1a42cc94c09b33a187868a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:57:51.159245 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-ddb558b9-4112-49ab-8c73-c3f59f01d310 tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] 10.222.0.26 "GET /compute/v2.1/servers/ca6cb405-f00a-4fcf-9147-824793f35ebf" status: 200 len: 1518 microversion: 2.1 time: 0.201626 Mar 05 02:57:51.159814 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 320/653] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:57:50 2022] GET /compute/v2.1/servers/ca6cb405-f00a-4fcf-9147-824793f35ebf => generated 1518 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 02:57:51.872757 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-2d0a3ba6-cbcf-4f48-ad3b-7e1aa99a2a69 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:57:51.873379 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-2d0a3ba6-cbcf-4f48-ad3b-7e1aa99a2a69 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] [instance: 1b31d7bf-888c-45a2-bc3a-e7077ad3a96d] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:57:51.879988 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-2d0a3ba6-cbcf-4f48-ad3b-7e1aa99a2a69 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:57:51.880442 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-2d0a3ba6-cbcf-4f48-ad3b-7e1aa99a2a69 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:57:51.881253 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-2d0a3ba6-cbcf-4f48-ad3b-7e1aa99a2a69 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:57:51.881695 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-2d0a3ba6-cbcf-4f48-ad3b-7e1aa99a2a69 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:57:52.026561 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-2d0a3ba6-cbcf-4f48-ad3b-7e1aa99a2a69 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:57:52.035098 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-2d0a3ba6-cbcf-4f48-ad3b-7e1aa99a2a69 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:57:52.036536 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-2d0a3ba6-cbcf-4f48-ad3b-7e1aa99a2a69 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:57:52.037698 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-2d0a3ba6-cbcf-4f48-ad3b-7e1aa99a2a69 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] 10.222.0.26 "GET /compute/v2.1/servers/1b31d7bf-888c-45a2-bc3a-e7077ad3a96d" status: 200 len: 1728 microversion: 2.20 time: 0.169344 Mar 05 02:57:52.038329 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 334/654] 10.222.0.26 () {60 vars in 1276 bytes} [Sat Mar 5 02:57:51 2022] GET /compute/v2.1/servers/1b31d7bf-888c-45a2-bc3a-e7077ad3a96d => generated 1728 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 02:57:52.176389 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-684b9f28-cb62-4b6a-921a-4569fe86646f tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:57:52.177050 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-684b9f28-cb62-4b6a-921a-4569fe86646f tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] [instance: ca6cb405-f00a-4fcf-9147-824793f35ebf] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:57:52.183287 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-684b9f28-cb62-4b6a-921a-4569fe86646f tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:57:52.183741 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-684b9f28-cb62-4b6a-921a-4569fe86646f tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:57:52.184506 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-684b9f28-cb62-4b6a-921a-4569fe86646f tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:57:52.184943 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-684b9f28-cb62-4b6a-921a-4569fe86646f tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:57:52.365533 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-684b9f28-cb62-4b6a-921a-4569fe86646f tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c68b816379942e282577e3d8d624ae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47835ba5de1a42cc94c09b33a187868a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:57:52.372869 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-684b9f28-cb62-4b6a-921a-4569fe86646f tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] 10.222.0.26 "GET /compute/v2.1/servers/ca6cb405-f00a-4fcf-9147-824793f35ebf" status: 200 len: 1576 microversion: 2.1 time: 0.200859 Mar 05 02:57:52.373456 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 321/655] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:57:52 2022] GET /compute/v2.1/servers/ca6cb405-f00a-4fcf-9147-824793f35ebf => generated 1576 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 02:57:52.591234 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [req-dbb97950-1c01-4795-a420-6cbed7dcbc79 req-5908f912-d81f-43ea-923e-ed3a7e48ed83 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b31d7bf-888c-45a2-bc3a-e7077ad3a96d", "name": "network-vif-plugged", "status": "completed", "tag": "72f8e9b7-28cd-4b80-be32-d7f04625063d"}]} {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 02:57:52.600151 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [req-dbb97950-1c01-4795-a420-6cbed7dcbc79 req-5908f912-d81f-43ea-923e-ed3a7e48ed83 service nova] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:57:52.600606 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [req-dbb97950-1c01-4795-a420-6cbed7dcbc79 req-5908f912-d81f-43ea-923e-ed3a7e48ed83 service nova] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:57:52.614316 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.compute.server_external_events [req-dbb97950-1c01-4795-a420-6cbed7dcbc79 req-5908f912-d81f-43ea-923e-ed3a7e48ed83 service nova] Creating event network-vif-plugged:72f8e9b7-28cd-4b80-be32-d7f04625063d for instance 1b31d7bf-888c-45a2-bc3a-e7077ad3a96d on hv-cinder-82725 Mar 05 02:57:52.619395 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [req-dbb97950-1c01-4795-a420-6cbed7dcbc79 req-5908f912-d81f-43ea-923e-ed3a7e48ed83 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031892 Mar 05 02:57:52.620251 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 335/656] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Mar 5 02:57:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 02:57:52.908724 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-46156b17-0a2f-4320-9926-e47f51298108 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:57:52.909308 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-46156b17-0a2f-4320-9926-e47f51298108 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] [instance: cd7bf2d1-7563-4057-8f9b-b7e51d741a6c] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:57:52.915201 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-46156b17-0a2f-4320-9926-e47f51298108 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:57:52.915722 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-46156b17-0a2f-4320-9926-e47f51298108 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:57:52.916570 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-46156b17-0a2f-4320-9926-e47f51298108 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:57:52.917081 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-46156b17-0a2f-4320-9926-e47f51298108 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:57:52.940684 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-46156b17-0a2f-4320-9926-e47f51298108 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] 10.222.0.26 "GET /compute/v2.1/servers/cd7bf2d1-7563-4057-8f9b-b7e51d741a6c/ips" status: 200 len: 150 microversion: 2.1 time: 0.036065 Mar 05 02:57:52.941263 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 322/657] 10.222.0.26 () {58 vars in 1247 bytes} [Sat Mar 5 02:57:52 2022] GET /compute/v2.1/servers/cd7bf2d1-7563-4057-8f9b-b7e51d741a6c/ips => generated 150 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 02:57:52.953187 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-ad78e7e1-2986-44b0-b10d-39b5f07b642c tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0f93f6b2-9d01-4384-b524-bd602fd0bd41"}} {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 02:57:52.954378 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-ad78e7e1-2986-44b0-b10d-39b5f07b642c tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] [instance: cd7bf2d1-7563-4057-8f9b-b7e51d741a6c] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:57:52.960355 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-ad78e7e1-2986-44b0-b10d-39b5f07b642c tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:57:52.960805 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-ad78e7e1-2986-44b0-b10d-39b5f07b642c tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:57:52.961580 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-ad78e7e1-2986-44b0-b10d-39b5f07b642c tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:57:52.962039 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-ad78e7e1-2986-44b0-b10d-39b5f07b642c tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:57:53.038565 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.wsgi [None req-ad78e7e1-2986-44b0-b10d-39b5f07b642c tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] HTTP exception thrown: Invalid volume: volume 0f93f6b2-9d01-4384-b524-bd602fd0bd41 is already attached to instances: ec6e78b4-5147-4f9b-84ce-c5d5ec0bd30d Mar 05 02:57:53.039160 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-ad78e7e1-2986-44b0-b10d-39b5f07b642c tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Returning 400 to user: Invalid volume: volume 0f93f6b2-9d01-4384-b524-bd602fd0bd41 is already attached to instances: ec6e78b4-5147-4f9b-84ce-c5d5ec0bd30d {{(pid=123545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 02:57:53.039994 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-ad78e7e1-2986-44b0-b10d-39b5f07b642c tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] 10.222.0.26 "POST /compute/v2.1/servers/cd7bf2d1-7563-4057-8f9b-b7e51d741a6c/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.091658 Mar 05 02:57:53.040549 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 336/658] 10.222.0.26 () {60 vars in 1322 bytes} [Sat Mar 5 02:57:52 2022] POST /compute/v2.1/servers/cd7bf2d1-7563-4057-8f9b-b7e51d741a6c/os-volume_attachments => generated 174 bytes in 93 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Mar 05 02:57:53.049565 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-d8d4d454-9113-4f13-b52d-fc49618e8def tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:57:53.050096 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-d8d4d454-9113-4f13-b52d-fc49618e8def tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] [instance: cd7bf2d1-7563-4057-8f9b-b7e51d741a6c] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:57:53.055717 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-7f07f323-d486-411c-96eb-9bed33a69a3f tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:57:53.056099 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-d8d4d454-9113-4f13-b52d-fc49618e8def tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:57:53.056317 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-7f07f323-d486-411c-96eb-9bed33a69a3f tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] [instance: 1b31d7bf-888c-45a2-bc3a-e7077ad3a96d] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:57:53.056549 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-d8d4d454-9113-4f13-b52d-fc49618e8def tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:57:53.057343 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-d8d4d454-9113-4f13-b52d-fc49618e8def tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:57:53.057783 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-d8d4d454-9113-4f13-b52d-fc49618e8def tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:57:53.063046 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-7f07f323-d486-411c-96eb-9bed33a69a3f tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:57:53.063598 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-7f07f323-d486-411c-96eb-9bed33a69a3f tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:57:53.064712 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-7f07f323-d486-411c-96eb-9bed33a69a3f tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:57:53.065156 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-7f07f323-d486-411c-96eb-9bed33a69a3f tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:57:53.084347 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-d8d4d454-9113-4f13-b52d-fc49618e8def tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] [instance: cd7bf2d1-7563-4057-8f9b-b7e51d741a6c] Going to try to terminate instance {{(pid=123546) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 05 02:57:53.160305 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-d8d4d454-9113-4f13-b52d-fc49618e8def tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] 10.222.0.26 "DELETE /compute/v2.1/servers/cd7bf2d1-7563-4057-8f9b-b7e51d741a6c" status: 204 len: 0 microversion: 2.1 time: 0.115043 Mar 05 02:57:53.160894 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 323/659] 10.222.0.26 () {58 vars in 1238 bytes} [Sat Mar 5 02:57:53 2022] DELETE /compute/v2.1/servers/cd7bf2d1-7563-4057-8f9b-b7e51d741a6c => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 05 02:57:53.169071 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-a9dd7db7-3b9c-44ae-b56b-6ff4af389126 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:57:53.169764 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-a9dd7db7-3b9c-44ae-b56b-6ff4af389126 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] [instance: cd7bf2d1-7563-4057-8f9b-b7e51d741a6c] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:57:53.176639 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-a9dd7db7-3b9c-44ae-b56b-6ff4af389126 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:57:53.177220 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-a9dd7db7-3b9c-44ae-b56b-6ff4af389126 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:57:53.177841 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-a9dd7db7-3b9c-44ae-b56b-6ff4af389126 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:57:53.178309 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-a9dd7db7-3b9c-44ae-b56b-6ff4af389126 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:57:53.205773 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-7f07f323-d486-411c-96eb-9bed33a69a3f tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:57:53.216254 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-7f07f323-d486-411c-96eb-9bed33a69a3f tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:57:53.218612 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-7f07f323-d486-411c-96eb-9bed33a69a3f tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:57:53.220817 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-7f07f323-d486-411c-96eb-9bed33a69a3f tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] 10.222.0.26 "GET /compute/v2.1/servers/1b31d7bf-888c-45a2-bc3a-e7077ad3a96d" status: 200 len: 1728 microversion: 2.20 time: 0.167918 Mar 05 02:57:53.221655 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 337/660] 10.222.0.26 () {60 vars in 1276 bytes} [Sat Mar 5 02:57:53 2022] GET /compute/v2.1/servers/1b31d7bf-888c-45a2-bc3a-e7077ad3a96d => generated 1728 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 05 02:57:53.316714 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-a9dd7db7-3b9c-44ae-b56b-6ff4af389126 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af8fb7f45f4d4eb180ccaca3d52ed2dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dd2b27540c04b4c8741ce8c9a5e2b47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:57:53.323921 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-a9dd7db7-3b9c-44ae-b56b-6ff4af389126 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] 10.222.0.26 "GET /compute/v2.1/servers/cd7bf2d1-7563-4057-8f9b-b7e51d741a6c" status: 200 len: 1681 microversion: 2.1 time: 0.158849 Mar 05 02:57:53.324483 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 324/661] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:57:53 2022] GET /compute/v2.1/servers/cd7bf2d1-7563-4057-8f9b-b7e51d741a6c => generated 1681 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 02:57:53.390392 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-afea7d27-7dd9-4a20-a933-8217e8eaade8 tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:57:53.391009 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-afea7d27-7dd9-4a20-a933-8217e8eaade8 tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] [instance: ca6cb405-f00a-4fcf-9147-824793f35ebf] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:57:53.397679 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-afea7d27-7dd9-4a20-a933-8217e8eaade8 tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:57:53.398178 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-afea7d27-7dd9-4a20-a933-8217e8eaade8 tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:57:53.398957 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-afea7d27-7dd9-4a20-a933-8217e8eaade8 tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:57:53.399462 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-afea7d27-7dd9-4a20-a933-8217e8eaade8 tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:57:53.531392 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-afea7d27-7dd9-4a20-a933-8217e8eaade8 tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c68b816379942e282577e3d8d624ae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47835ba5de1a42cc94c09b33a187868a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:57:53.539281 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-afea7d27-7dd9-4a20-a933-8217e8eaade8 tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] 10.222.0.26 "GET /compute/v2.1/servers/ca6cb405-f00a-4fcf-9147-824793f35ebf" status: 200 len: 1576 microversion: 2.1 time: 0.152743 Mar 05 02:57:53.539856 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 338/662] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:57:53 2022] GET /compute/v2.1/servers/ca6cb405-f00a-4fcf-9147-824793f35ebf => generated 1576 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 02:57:54.242879 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-832d5dca-f37d-4f33-a1a7-cdd91fe7007c tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:57:54.243489 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-832d5dca-f37d-4f33-a1a7-cdd91fe7007c tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] [instance: 1b31d7bf-888c-45a2-bc3a-e7077ad3a96d] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:57:54.250262 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-832d5dca-f37d-4f33-a1a7-cdd91fe7007c tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:57:54.250788 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-832d5dca-f37d-4f33-a1a7-cdd91fe7007c tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:57:54.251887 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-832d5dca-f37d-4f33-a1a7-cdd91fe7007c tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:57:54.252394 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-832d5dca-f37d-4f33-a1a7-cdd91fe7007c tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:57:54.341756 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-03b4567d-c238-4ff7-a848-b757b2135dcc tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:57:54.342400 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-03b4567d-c238-4ff7-a848-b757b2135dcc tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] [instance: cd7bf2d1-7563-4057-8f9b-b7e51d741a6c] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:57:54.349440 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-03b4567d-c238-4ff7-a848-b757b2135dcc tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:57:54.349686 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-03b4567d-c238-4ff7-a848-b757b2135dcc tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:57:54.350415 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-03b4567d-c238-4ff7-a848-b757b2135dcc tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:57:54.350856 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-03b4567d-c238-4ff7-a848-b757b2135dcc tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:57:54.404128 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-832d5dca-f37d-4f33-a1a7-cdd91fe7007c tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:57:54.413499 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-832d5dca-f37d-4f33-a1a7-cdd91fe7007c tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:57:54.415185 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-832d5dca-f37d-4f33-a1a7-cdd91fe7007c tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:57:54.416559 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-832d5dca-f37d-4f33-a1a7-cdd91fe7007c tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] 10.222.0.26 "GET /compute/v2.1/servers/1b31d7bf-888c-45a2-bc3a-e7077ad3a96d" status: 200 len: 1728 microversion: 2.20 time: 0.180899 Mar 05 02:57:54.417584 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 325/663] 10.222.0.26 () {60 vars in 1276 bytes} [Sat Mar 5 02:57:54 2022] GET /compute/v2.1/servers/1b31d7bf-888c-45a2-bc3a-e7077ad3a96d => generated 1728 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 02:57:54.502906 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-03b4567d-c238-4ff7-a848-b757b2135dcc tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af8fb7f45f4d4eb180ccaca3d52ed2dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dd2b27540c04b4c8741ce8c9a5e2b47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:57:54.511023 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-03b4567d-c238-4ff7-a848-b757b2135dcc tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] 10.222.0.26 "GET /compute/v2.1/servers/cd7bf2d1-7563-4057-8f9b-b7e51d741a6c" status: 200 len: 1681 microversion: 2.1 time: 0.173458 Mar 05 02:57:54.511878 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 339/664] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:57:54 2022] GET /compute/v2.1/servers/cd7bf2d1-7563-4057-8f9b-b7e51d741a6c => generated 1681 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 02:57:54.556470 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-7adb4aae-ce0b-4ec7-9e42-3084390bc7f6 tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:57:54.557395 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-7adb4aae-ce0b-4ec7-9e42-3084390bc7f6 tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] [instance: ca6cb405-f00a-4fcf-9147-824793f35ebf] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:57:54.563477 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-7adb4aae-ce0b-4ec7-9e42-3084390bc7f6 tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:57:54.564115 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-7adb4aae-ce0b-4ec7-9e42-3084390bc7f6 tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:57:54.564905 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-7adb4aae-ce0b-4ec7-9e42-3084390bc7f6 tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:57:54.565348 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-7adb4aae-ce0b-4ec7-9e42-3084390bc7f6 tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:57:54.636459 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [req-92fb85cf-7e99-42a5-b7b5-ab9da9969334 req-be11919f-9797-4836-97ed-d2ee71a95d29 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca6cb405-f00a-4fcf-9147-824793f35ebf", "name": "network-vif-unplugged", "status": "completed", "tag": "6c993446-3f76-4f92-94ad-2054b8a5ebfe"}]} {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 02:57:54.645807 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [req-92fb85cf-7e99-42a5-b7b5-ab9da9969334 req-be11919f-9797-4836-97ed-d2ee71a95d29 service nova] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:57:54.646622 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [req-92fb85cf-7e99-42a5-b7b5-ab9da9969334 req-be11919f-9797-4836-97ed-d2ee71a95d29 service nova] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:57:54.659473 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.compute.server_external_events [req-92fb85cf-7e99-42a5-b7b5-ab9da9969334 req-be11919f-9797-4836-97ed-d2ee71a95d29 service nova] Creating event network-vif-unplugged:6c993446-3f76-4f92-94ad-2054b8a5ebfe for instance ca6cb405-f00a-4fcf-9147-824793f35ebf on hv-cinder-82725 Mar 05 02:57:54.664667 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [req-92fb85cf-7e99-42a5-b7b5-ab9da9969334 req-be11919f-9797-4836-97ed-d2ee71a95d29 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032082 Mar 05 02:57:54.665757 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 340/665] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Mar 5 02:57:54 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 05 02:57:54.705009 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-7adb4aae-ce0b-4ec7-9e42-3084390bc7f6 tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c68b816379942e282577e3d8d624ae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47835ba5de1a42cc94c09b33a187868a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:57:54.713410 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-7adb4aae-ce0b-4ec7-9e42-3084390bc7f6 tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] 10.222.0.26 "GET /compute/v2.1/servers/ca6cb405-f00a-4fcf-9147-824793f35ebf" status: 200 len: 1576 microversion: 2.1 time: 0.160624 Mar 05 02:57:54.714002 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 326/666] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:57:54 2022] GET /compute/v2.1/servers/ca6cb405-f00a-4fcf-9147-824793f35ebf => generated 1576 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 02:57:55.437034 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-726f6036-9ef6-4f0d-8cc7-64d361e71e0a tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:57:55.437726 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-726f6036-9ef6-4f0d-8cc7-64d361e71e0a tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] [instance: 1b31d7bf-888c-45a2-bc3a-e7077ad3a96d] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:57:55.445137 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-726f6036-9ef6-4f0d-8cc7-64d361e71e0a tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:57:55.445651 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-726f6036-9ef6-4f0d-8cc7-64d361e71e0a tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:57:55.446527 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-726f6036-9ef6-4f0d-8cc7-64d361e71e0a tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:57:55.446966 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-726f6036-9ef6-4f0d-8cc7-64d361e71e0a tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:57:55.528600 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-fe590623-efaf-4cbe-a942-61c3d7362b64 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:57:55.529392 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-fe590623-efaf-4cbe-a942-61c3d7362b64 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] [instance: cd7bf2d1-7563-4057-8f9b-b7e51d741a6c] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:57:55.536503 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-fe590623-efaf-4cbe-a942-61c3d7362b64 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:57:55.536946 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-fe590623-efaf-4cbe-a942-61c3d7362b64 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:57:55.537717 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-fe590623-efaf-4cbe-a942-61c3d7362b64 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:57:55.538182 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-fe590623-efaf-4cbe-a942-61c3d7362b64 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:57:55.628672 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-fe590623-efaf-4cbe-a942-61c3d7362b64 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af8fb7f45f4d4eb180ccaca3d52ed2dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dd2b27540c04b4c8741ce8c9a5e2b47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:57:55.635974 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-fe590623-efaf-4cbe-a942-61c3d7362b64 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] 10.222.0.26 "GET /compute/v2.1/servers/cd7bf2d1-7563-4057-8f9b-b7e51d741a6c" status: 200 len: 1614 microversion: 2.1 time: 0.111272 Mar 05 02:57:55.636590 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 327/667] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:57:55 2022] GET /compute/v2.1/servers/cd7bf2d1-7563-4057-8f9b-b7e51d741a6c => generated 1614 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 02:57:55.732396 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-2e96d7d2-e59f-46b9-b6cd-e4937f4d825b tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:57:55.733155 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-2e96d7d2-e59f-46b9-b6cd-e4937f4d825b tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] [instance: ca6cb405-f00a-4fcf-9147-824793f35ebf] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:57:55.735292 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-726f6036-9ef6-4f0d-8cc7-64d361e71e0a tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:57:55.739567 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-2e96d7d2-e59f-46b9-b6cd-e4937f4d825b tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:57:55.740092 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-2e96d7d2-e59f-46b9-b6cd-e4937f4d825b tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:57:55.741138 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-2e96d7d2-e59f-46b9-b6cd-e4937f4d825b tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:57:55.741691 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-2e96d7d2-e59f-46b9-b6cd-e4937f4d825b tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:57:55.744008 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-726f6036-9ef6-4f0d-8cc7-64d361e71e0a tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:57:55.745657 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-726f6036-9ef6-4f0d-8cc7-64d361e71e0a tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:57:55.747041 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-726f6036-9ef6-4f0d-8cc7-64d361e71e0a tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] 10.222.0.26 "GET /compute/v2.1/servers/1b31d7bf-888c-45a2-bc3a-e7077ad3a96d" status: 200 len: 1715 microversion: 2.20 time: 0.314699 Mar 05 02:57:55.747636 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 341/668] 10.222.0.26 () {60 vars in 1276 bytes} [Sat Mar 5 02:57:55 2022] GET /compute/v2.1/servers/1b31d7bf-888c-45a2-bc3a-e7077ad3a96d => generated 1715 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 02:57:55.908494 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [req-a58f6b0d-3ad0-4bd0-ab71-8a58528175d7 req-0941e155-3558-4fdf-90b8-b896b336ec04 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd7bf2d1-7563-4057-8f9b-b7e51d741a6c", "name": "network-vif-deleted", "tag": "e30d5b85-41e6-47b6-930e-a7a045a9d2fb"}]} {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 02:57:55.921116 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [req-a58f6b0d-3ad0-4bd0-ab71-8a58528175d7 req-0941e155-3558-4fdf-90b8-b896b336ec04 service nova] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:57:55.922089 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [req-a58f6b0d-3ad0-4bd0-ab71-8a58528175d7 req-0941e155-3558-4fdf-90b8-b896b336ec04 service nova] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:57:55.944255 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.compute.server_external_events [req-a58f6b0d-3ad0-4bd0-ab71-8a58528175d7 req-0941e155-3558-4fdf-90b8-b896b336ec04 service nova] Creating event network-vif-deleted:e30d5b85-41e6-47b6-930e-a7a045a9d2fb for instance cd7bf2d1-7563-4057-8f9b-b7e51d741a6c on hv-cinder-82725 Mar 05 02:57:55.957309 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [req-a58f6b0d-3ad0-4bd0-ab71-8a58528175d7 req-0941e155-3558-4fdf-90b8-b896b336ec04 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053419 Mar 05 02:57:55.958437 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 342/669] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Mar 5 02:57:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 05 02:57:55.995797 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-2e96d7d2-e59f-46b9-b6cd-e4937f4d825b tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c68b816379942e282577e3d8d624ae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47835ba5de1a42cc94c09b33a187868a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:57:56.005533 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-2e96d7d2-e59f-46b9-b6cd-e4937f4d825b tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] 10.222.0.26 "GET /compute/v2.1/servers/ca6cb405-f00a-4fcf-9147-824793f35ebf" status: 200 len: 1576 microversion: 2.1 time: 0.277362 Mar 05 02:57:56.006922 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 328/670] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:57:55 2022] GET /compute/v2.1/servers/ca6cb405-f00a-4fcf-9147-824793f35ebf => generated 1576 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 02:57:56.654845 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-27a6e234-2a77-47e2-be8d-dd03fbfbc96f tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:57:56.655536 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-27a6e234-2a77-47e2-be8d-dd03fbfbc96f tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] [instance: cd7bf2d1-7563-4057-8f9b-b7e51d741a6c] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:57:56.661597 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-27a6e234-2a77-47e2-be8d-dd03fbfbc96f tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:57:56.662073 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-27a6e234-2a77-47e2-be8d-dd03fbfbc96f tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:57:56.662845 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-27a6e234-2a77-47e2-be8d-dd03fbfbc96f tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:57:56.663273 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-27a6e234-2a77-47e2-be8d-dd03fbfbc96f tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:57:56.682284 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.wsgi [None req-27a6e234-2a77-47e2-be8d-dd03fbfbc96f tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] HTTP exception thrown: Instance cd7bf2d1-7563-4057-8f9b-b7e51d741a6c could not be found. Mar 05 02:57:56.682878 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-27a6e234-2a77-47e2-be8d-dd03fbfbc96f tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Returning 404 to user: Instance cd7bf2d1-7563-4057-8f9b-b7e51d741a6c could not be found. {{(pid=123545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 02:57:56.683701 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-27a6e234-2a77-47e2-be8d-dd03fbfbc96f tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] 10.222.0.26 "GET /compute/v2.1/servers/cd7bf2d1-7563-4057-8f9b-b7e51d741a6c" status: 404 len: 111 microversion: 2.1 time: 0.033729 Mar 05 02:57:56.684263 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 343/671] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:57:56 2022] GET /compute/v2.1/servers/cd7bf2d1-7563-4057-8f9b-b7e51d741a6c => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 05 02:57:56.693478 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-ebce8da0-4cfd-45dd-9412-0844b9cf84a5 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Calling method '.version_select at 0x7f3f61e08ca0>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:57:56.711416 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-ebce8da0-4cfd-45dd-9412-0844b9cf84a5 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2107035222" status: 202 len: 0 microversion: 2.1 time: 0.022432 Mar 05 02:57:56.712063 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 329/672] 10.222.0.26 () {58 vars in 1220 bytes} [Sat Mar 5 02:57:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2107035222 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 05 02:57:57.023933 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-be3cfcec-d3cd-4f94-8be5-229ebd6987e5 tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:57:57.024432 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-be3cfcec-d3cd-4f94-8be5-229ebd6987e5 tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] [instance: ca6cb405-f00a-4fcf-9147-824793f35ebf] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:57:57.030626 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-be3cfcec-d3cd-4f94-8be5-229ebd6987e5 tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:57:57.031160 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-be3cfcec-d3cd-4f94-8be5-229ebd6987e5 tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:57:57.032229 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-be3cfcec-d3cd-4f94-8be5-229ebd6987e5 tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:57:57.033288 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-be3cfcec-d3cd-4f94-8be5-229ebd6987e5 tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:57:57.175145 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-be3cfcec-d3cd-4f94-8be5-229ebd6987e5 tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c68b816379942e282577e3d8d624ae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47835ba5de1a42cc94c09b33a187868a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:57:57.182655 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-be3cfcec-d3cd-4f94-8be5-229ebd6987e5 tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] 10.222.0.26 "GET /compute/v2.1/servers/ca6cb405-f00a-4fcf-9147-824793f35ebf" status: 200 len: 1576 microversion: 2.1 time: 0.162987 Mar 05 02:57:57.183224 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 344/673] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:57:57 2022] GET /compute/v2.1/servers/ca6cb405-f00a-4fcf-9147-824793f35ebf => generated 1576 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 02:57:57.409405 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-38e9db11-ca8a-4785-86b6-e1dbb04731ef tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:57:57.409924 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-38e9db11-ca8a-4785-86b6-e1dbb04731ef tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] [instance: ec6e78b4-5147-4f9b-84ce-c5d5ec0bd30d] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:57:57.415875 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-38e9db11-ca8a-4785-86b6-e1dbb04731ef tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:57:57.416267 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-38e9db11-ca8a-4785-86b6-e1dbb04731ef tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:57:57.417029 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-38e9db11-ca8a-4785-86b6-e1dbb04731ef tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:57:57.417461 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-38e9db11-ca8a-4785-86b6-e1dbb04731ef tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:57:57.494067 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.objects.instance [None req-38e9db11-ca8a-4785-86b6-e1dbb04731ef tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lazy-loading 'services' on Instance uuid ec6e78b4-5147-4f9b-84ce-c5d5ec0bd30d {{(pid=123546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 05 02:57:57.562655 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-38e9db11-ca8a-4785-86b6-e1dbb04731ef tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] 10.222.0.26 "DELETE /compute/v2.1/servers/ec6e78b4-5147-4f9b-84ce-c5d5ec0bd30d/os-volume_attachments/0f93f6b2-9d01-4384-b524-bd602fd0bd41" status: 202 len: 0 microversion: 2.1 time: 0.158028 Mar 05 02:57:57.563267 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 330/674] 10.222.0.26 () {58 vars in 1415 bytes} [Sat Mar 5 02:57:57 2022] DELETE /compute/v2.1/servers/ec6e78b4-5147-4f9b-84ce-c5d5ec0bd30d/os-volume_attachments/0f93f6b2-9d01-4384-b524-bd602fd0bd41 => generated 0 bytes in 160 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 05 02:57:57.571749 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-2c71b051-45dc-4e1b-9978-55e5136adb0a tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:57:57.572697 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-2c71b051-45dc-4e1b-9978-55e5136adb0a tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] [instance: ec6e78b4-5147-4f9b-84ce-c5d5ec0bd30d] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:57:57.578452 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-2c71b051-45dc-4e1b-9978-55e5136adb0a tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:57:57.578906 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-2c71b051-45dc-4e1b-9978-55e5136adb0a tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:57:57.580372 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-2c71b051-45dc-4e1b-9978-55e5136adb0a tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:57:57.580816 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-2c71b051-45dc-4e1b-9978-55e5136adb0a tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:57:57.610015 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-2c71b051-45dc-4e1b-9978-55e5136adb0a tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] 10.222.0.26 "GET /compute/v2.1/servers/ec6e78b4-5147-4f9b-84ce-c5d5ec0bd30d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042145 Mar 05 02:57:57.612617 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 345/675] 10.222.0.26 () {58 vars in 1301 bytes} [Sat Mar 5 02:57:57 2022] GET /compute/v2.1/servers/ec6e78b4-5147-4f9b-84ce-c5d5ec0bd30d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 02:57:58.201478 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-281fe7ca-9f50-4d70-92ef-50a2b02f8a76 tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:57:58.202207 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-281fe7ca-9f50-4d70-92ef-50a2b02f8a76 tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] [instance: ca6cb405-f00a-4fcf-9147-824793f35ebf] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:57:58.208261 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-281fe7ca-9f50-4d70-92ef-50a2b02f8a76 tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:57:58.208716 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-281fe7ca-9f50-4d70-92ef-50a2b02f8a76 tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:57:58.209484 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-281fe7ca-9f50-4d70-92ef-50a2b02f8a76 tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:57:58.209924 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-281fe7ca-9f50-4d70-92ef-50a2b02f8a76 tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:57:58.588473 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-281fe7ca-9f50-4d70-92ef-50a2b02f8a76 tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c68b816379942e282577e3d8d624ae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47835ba5de1a42cc94c09b33a187868a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:57:58.596119 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-281fe7ca-9f50-4d70-92ef-50a2b02f8a76 tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] 10.222.0.26 "GET /compute/v2.1/servers/ca6cb405-f00a-4fcf-9147-824793f35ebf" status: 200 len: 1576 microversion: 2.1 time: 0.399490 Mar 05 02:57:58.596697 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 331/676] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:57:58 2022] GET /compute/v2.1/servers/ca6cb405-f00a-4fcf-9147-824793f35ebf => generated 1576 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 02:57:58.623535 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-afe83986-0b60-415d-af21-da85b83c58ab tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:57:58.624472 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-afe83986-0b60-415d-af21-da85b83c58ab tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] [instance: ec6e78b4-5147-4f9b-84ce-c5d5ec0bd30d] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:57:58.631978 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-afe83986-0b60-415d-af21-da85b83c58ab tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:57:58.632436 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-afe83986-0b60-415d-af21-da85b83c58ab tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:57:58.633252 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-afe83986-0b60-415d-af21-da85b83c58ab tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:57:58.633713 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-afe83986-0b60-415d-af21-da85b83c58ab tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:57:58.661930 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-afe83986-0b60-415d-af21-da85b83c58ab tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] 10.222.0.26 "GET /compute/v2.1/servers/ec6e78b4-5147-4f9b-84ce-c5d5ec0bd30d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042404 Mar 05 02:57:58.662509 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 346/677] 10.222.0.26 () {58 vars in 1301 bytes} [Sat Mar 5 02:57:58 2022] GET /compute/v2.1/servers/ec6e78b4-5147-4f9b-84ce-c5d5ec0bd30d/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 05 02:57:58.718379 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-22ecbfd4-1828-4e97-8071-8a697c7b54a0 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:57:58.718868 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-22ecbfd4-1828-4e97-8071-8a697c7b54a0 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] [instance: ec6e78b4-5147-4f9b-84ce-c5d5ec0bd30d] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:57:58.724623 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-22ecbfd4-1828-4e97-8071-8a697c7b54a0 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:57:58.725070 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-22ecbfd4-1828-4e97-8071-8a697c7b54a0 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:57:58.725837 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-22ecbfd4-1828-4e97-8071-8a697c7b54a0 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:57:58.726299 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-22ecbfd4-1828-4e97-8071-8a697c7b54a0 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:57:58.749881 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-22ecbfd4-1828-4e97-8071-8a697c7b54a0 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] [instance: ec6e78b4-5147-4f9b-84ce-c5d5ec0bd30d] Going to try to terminate instance {{(pid=123546) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 05 02:57:58.825166 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-22ecbfd4-1828-4e97-8071-8a697c7b54a0 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] 10.222.0.26 "DELETE /compute/v2.1/servers/ec6e78b4-5147-4f9b-84ce-c5d5ec0bd30d" status: 204 len: 0 microversion: 2.1 time: 0.110227 Mar 05 02:57:58.826189 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 332/678] 10.222.0.26 () {58 vars in 1238 bytes} [Sat Mar 5 02:57:58 2022] DELETE /compute/v2.1/servers/ec6e78b4-5147-4f9b-84ce-c5d5ec0bd30d => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 05 02:57:58.835054 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-540786de-6cc6-4e10-b4a9-86dfa51d8f68 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:57:58.835669 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-540786de-6cc6-4e10-b4a9-86dfa51d8f68 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] [instance: ec6e78b4-5147-4f9b-84ce-c5d5ec0bd30d] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:57:58.842060 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-540786de-6cc6-4e10-b4a9-86dfa51d8f68 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:57:58.842558 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-540786de-6cc6-4e10-b4a9-86dfa51d8f68 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:57:58.843274 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-540786de-6cc6-4e10-b4a9-86dfa51d8f68 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:57:58.843714 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-540786de-6cc6-4e10-b4a9-86dfa51d8f68 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:57:58.970819 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-540786de-6cc6-4e10-b4a9-86dfa51d8f68 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af8fb7f45f4d4eb180ccaca3d52ed2dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dd2b27540c04b4c8741ce8c9a5e2b47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:57:58.978327 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-540786de-6cc6-4e10-b4a9-86dfa51d8f68 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] 10.222.0.26 "GET /compute/v2.1/servers/ec6e78b4-5147-4f9b-84ce-c5d5ec0bd30d" status: 200 len: 1681 microversion: 2.1 time: 0.146996 Mar 05 02:57:58.978895 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 347/679] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:57:58 2022] GET /compute/v2.1/servers/ec6e78b4-5147-4f9b-84ce-c5d5ec0bd30d => generated 1681 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 02:57:59.614407 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-bd339415-51ff-49ad-b1c1-43e3fbb30945 tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:57:59.615110 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-bd339415-51ff-49ad-b1c1-43e3fbb30945 tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] [instance: ca6cb405-f00a-4fcf-9147-824793f35ebf] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:57:59.621314 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-bd339415-51ff-49ad-b1c1-43e3fbb30945 tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:57:59.621776 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-bd339415-51ff-49ad-b1c1-43e3fbb30945 tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:57:59.622592 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-bd339415-51ff-49ad-b1c1-43e3fbb30945 tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:57:59.623029 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-bd339415-51ff-49ad-b1c1-43e3fbb30945 tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:57:59.755663 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-bd339415-51ff-49ad-b1c1-43e3fbb30945 tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c68b816379942e282577e3d8d624ae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47835ba5de1a42cc94c09b33a187868a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:57:59.763018 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-bd339415-51ff-49ad-b1c1-43e3fbb30945 tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] 10.222.0.26 "GET /compute/v2.1/servers/ca6cb405-f00a-4fcf-9147-824793f35ebf" status: 200 len: 1576 microversion: 2.1 time: 0.154115 Mar 05 02:57:59.763595 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 333/680] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:57:59 2022] GET /compute/v2.1/servers/ca6cb405-f00a-4fcf-9147-824793f35ebf => generated 1576 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 02:57:59.996001 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-14f15149-b154-4aff-abd1-f97fcda6269e tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:57:59.996612 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-14f15149-b154-4aff-abd1-f97fcda6269e tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] [instance: ec6e78b4-5147-4f9b-84ce-c5d5ec0bd30d] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:58:00.003515 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-14f15149-b154-4aff-abd1-f97fcda6269e tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:58:00.003966 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-14f15149-b154-4aff-abd1-f97fcda6269e tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:58:00.004763 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-14f15149-b154-4aff-abd1-f97fcda6269e tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:58:00.005198 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-14f15149-b154-4aff-abd1-f97fcda6269e tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:58:00.138639 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-14f15149-b154-4aff-abd1-f97fcda6269e tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af8fb7f45f4d4eb180ccaca3d52ed2dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dd2b27540c04b4c8741ce8c9a5e2b47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:58:00.146444 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-14f15149-b154-4aff-abd1-f97fcda6269e tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] 10.222.0.26 "GET /compute/v2.1/servers/ec6e78b4-5147-4f9b-84ce-c5d5ec0bd30d" status: 200 len: 1681 microversion: 2.1 time: 0.154270 Mar 05 02:58:00.147017 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 348/681] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:57:59 2022] GET /compute/v2.1/servers/ec6e78b4-5147-4f9b-84ce-c5d5ec0bd30d => generated 1681 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 02:58:00.781338 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-1ea65ace-1235-4cc6-935c-70d1efca2ecb tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:58:00.781899 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-1ea65ace-1235-4cc6-935c-70d1efca2ecb tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] [instance: ca6cb405-f00a-4fcf-9147-824793f35ebf] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:58:00.789160 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-1ea65ace-1235-4cc6-935c-70d1efca2ecb tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:58:00.789649 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-1ea65ace-1235-4cc6-935c-70d1efca2ecb tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:58:00.790533 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-1ea65ace-1235-4cc6-935c-70d1efca2ecb tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:58:00.790994 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-1ea65ace-1235-4cc6-935c-70d1efca2ecb tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:58:00.929344 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-1ea65ace-1235-4cc6-935c-70d1efca2ecb tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c68b816379942e282577e3d8d624ae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47835ba5de1a42cc94c09b33a187868a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:58:00.936661 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-1ea65ace-1235-4cc6-935c-70d1efca2ecb tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] 10.222.0.26 "GET /compute/v2.1/servers/ca6cb405-f00a-4fcf-9147-824793f35ebf" status: 200 len: 1576 microversion: 2.1 time: 0.159546 Mar 05 02:58:00.937237 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 334/682] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:58:00 2022] GET /compute/v2.1/servers/ca6cb405-f00a-4fcf-9147-824793f35ebf => generated 1576 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 02:58:01.164342 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-dfb24b5f-cc4b-42fe-9ae4-a3ceca80f269 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:58:01.164943 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-dfb24b5f-cc4b-42fe-9ae4-a3ceca80f269 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] [instance: ec6e78b4-5147-4f9b-84ce-c5d5ec0bd30d] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:58:01.171321 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-dfb24b5f-cc4b-42fe-9ae4-a3ceca80f269 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:58:01.171780 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-dfb24b5f-cc4b-42fe-9ae4-a3ceca80f269 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:58:01.172666 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-dfb24b5f-cc4b-42fe-9ae4-a3ceca80f269 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:58:01.173659 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-dfb24b5f-cc4b-42fe-9ae4-a3ceca80f269 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:58:01.429363 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-dfb24b5f-cc4b-42fe-9ae4-a3ceca80f269 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af8fb7f45f4d4eb180ccaca3d52ed2dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dd2b27540c04b4c8741ce8c9a5e2b47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:58:01.436589 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-dfb24b5f-cc4b-42fe-9ae4-a3ceca80f269 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] 10.222.0.26 "GET /compute/v2.1/servers/ec6e78b4-5147-4f9b-84ce-c5d5ec0bd30d" status: 200 len: 1681 microversion: 2.1 time: 0.276264 Mar 05 02:58:01.437162 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 349/683] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:58:01 2022] GET /compute/v2.1/servers/ec6e78b4-5147-4f9b-84ce-c5d5ec0bd30d => generated 1681 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 02:58:01.954790 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-ca8bda84-2504-4a88-94c8-5b603eb6255e tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:58:01.955410 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-ca8bda84-2504-4a88-94c8-5b603eb6255e tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] [instance: ca6cb405-f00a-4fcf-9147-824793f35ebf] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:58:01.962561 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-ca8bda84-2504-4a88-94c8-5b603eb6255e tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:58:01.963019 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-ca8bda84-2504-4a88-94c8-5b603eb6255e tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:58:01.963799 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-ca8bda84-2504-4a88-94c8-5b603eb6255e tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:58:01.964270 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-ca8bda84-2504-4a88-94c8-5b603eb6255e tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:58:02.119760 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [req-5fa5de3b-be26-494a-baad-0f1a2751ddf8 req-04302fda-23af-49a4-b291-c713be9c19cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec6e78b4-5147-4f9b-84ce-c5d5ec0bd30d", "name": "network-vif-deleted", "tag": "4bb7ff98-132f-4f56-866f-09d5d21c9a76"}]} {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 02:58:02.138480 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [req-5fa5de3b-be26-494a-baad-0f1a2751ddf8 req-04302fda-23af-49a4-b291-c713be9c19cd service nova] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:58:02.139174 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [req-5fa5de3b-be26-494a-baad-0f1a2751ddf8 req-04302fda-23af-49a4-b291-c713be9c19cd service nova] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:58:02.170669 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.compute.server_external_events [req-5fa5de3b-be26-494a-baad-0f1a2751ddf8 req-04302fda-23af-49a4-b291-c713be9c19cd service nova] Creating event network-vif-deleted:4bb7ff98-132f-4f56-866f-09d5d21c9a76 for instance ec6e78b4-5147-4f9b-84ce-c5d5ec0bd30d on hv-cinder-82725 Mar 05 02:58:02.177185 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [req-5fa5de3b-be26-494a-baad-0f1a2751ddf8 req-04302fda-23af-49a4-b291-c713be9c19cd service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060864 Mar 05 02:58:02.178569 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 350/684] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Mar 5 02:58:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 02:58:02.213088 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-ca8bda84-2504-4a88-94c8-5b603eb6255e tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c68b816379942e282577e3d8d624ae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47835ba5de1a42cc94c09b33a187868a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:58:02.224170 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-ca8bda84-2504-4a88-94c8-5b603eb6255e tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] 10.222.0.26 "GET /compute/v2.1/servers/ca6cb405-f00a-4fcf-9147-824793f35ebf" status: 200 len: 1563 microversion: 2.1 time: 0.273561 Mar 05 02:58:02.225678 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 335/685] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:58:01 2022] GET /compute/v2.1/servers/ca6cb405-f00a-4fcf-9147-824793f35ebf => generated 1563 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 02:58:02.455422 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-d8da0b19-0f49-478e-892b-3b8f9abc57a3 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:58:02.456128 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-d8da0b19-0f49-478e-892b-3b8f9abc57a3 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] [instance: ec6e78b4-5147-4f9b-84ce-c5d5ec0bd30d] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:58:02.462206 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-d8da0b19-0f49-478e-892b-3b8f9abc57a3 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:58:02.462663 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-d8da0b19-0f49-478e-892b-3b8f9abc57a3 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:58:02.463461 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-d8da0b19-0f49-478e-892b-3b8f9abc57a3 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:58:02.463898 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-d8da0b19-0f49-478e-892b-3b8f9abc57a3 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:58:02.495444 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-d8da0b19-0f49-478e-892b-3b8f9abc57a3 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:58:02.495902 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-d8da0b19-0f49-478e-892b-3b8f9abc57a3 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:58:02.496356 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.objects.instance [None req-d8da0b19-0f49-478e-892b-3b8f9abc57a3 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lazy-loading 'fault' on Instance uuid ec6e78b4-5147-4f9b-84ce-c5d5ec0bd30d {{(pid=123545) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 05 02:58:02.538397 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-d8da0b19-0f49-478e-892b-3b8f9abc57a3 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af8fb7f45f4d4eb180ccaca3d52ed2dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dd2b27540c04b4c8741ce8c9a5e2b47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:58:02.545808 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-d8da0b19-0f49-478e-892b-3b8f9abc57a3 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] 10.222.0.26 "GET /compute/v2.1/servers/ec6e78b4-5147-4f9b-84ce-c5d5ec0bd30d" status: 200 len: 1332 microversion: 2.1 time: 0.095171 Mar 05 02:58:02.546654 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 351/686] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:58:02 2022] GET /compute/v2.1/servers/ec6e78b4-5147-4f9b-84ce-c5d5ec0bd30d => generated 1332 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 02:58:02.833649 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-37ac67f0-1e2a-443c-8c58-2c30a4e0b8ad tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:58:02.834247 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-37ac67f0-1e2a-443c-8c58-2c30a4e0b8ad tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] [instance: 4f97c839-ad1c-4b04-ac59-460b0de295ed] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:58:02.840201 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-37ac67f0-1e2a-443c-8c58-2c30a4e0b8ad tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:58:02.840842 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-37ac67f0-1e2a-443c-8c58-2c30a4e0b8ad tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:58:02.841700 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-37ac67f0-1e2a-443c-8c58-2c30a4e0b8ad tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:58:02.842161 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-37ac67f0-1e2a-443c-8c58-2c30a4e0b8ad tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:58:02.866467 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-37ac67f0-1e2a-443c-8c58-2c30a4e0b8ad tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] 10.222.0.26 "GET /compute/v2.1/servers/4f97c839-ad1c-4b04-ac59-460b0de295ed/ips" status: 200 len: 147 microversion: 2.1 time: 0.099444 Mar 05 02:58:02.867037 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 336/687] 10.222.0.26 () {58 vars in 1247 bytes} [Sat Mar 5 02:58:02 2022] GET /compute/v2.1/servers/4f97c839-ad1c-4b04-ac59-460b0de295ed/ips => generated 147 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 02:58:02.915878 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [req-04e3c948-3651-49b6-96aa-fdc2d9cd81f0 req-e7f5a6de-efe7-424c-bef3-bbf4fc744449 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca6cb405-f00a-4fcf-9147-824793f35ebf", "name": "network-vif-plugged", "status": "completed", "tag": "6c993446-3f76-4f92-94ad-2054b8a5ebfe"}]} {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 02:58:02.925596 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [req-04e3c948-3651-49b6-96aa-fdc2d9cd81f0 req-e7f5a6de-efe7-424c-bef3-bbf4fc744449 service nova] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:58:02.926504 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [req-04e3c948-3651-49b6-96aa-fdc2d9cd81f0 req-e7f5a6de-efe7-424c-bef3-bbf4fc744449 service nova] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:58:02.940791 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.compute.server_external_events [req-04e3c948-3651-49b6-96aa-fdc2d9cd81f0 req-e7f5a6de-efe7-424c-bef3-bbf4fc744449 service nova] Creating event network-vif-plugged:6c993446-3f76-4f92-94ad-2054b8a5ebfe for instance ca6cb405-f00a-4fcf-9147-824793f35ebf on hv-cinder-82725 Mar 05 02:58:02.945783 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [req-04e3c948-3651-49b6-96aa-fdc2d9cd81f0 req-e7f5a6de-efe7-424c-bef3-bbf4fc744449 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033937 Mar 05 02:58:02.946536 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 352/688] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Mar 5 02:58:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 02:58:03.565572 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-d5ced5bd-6a44-462b-8558-9be35b74901e tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:58:03.566139 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-d5ced5bd-6a44-462b-8558-9be35b74901e tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] [instance: ec6e78b4-5147-4f9b-84ce-c5d5ec0bd30d] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:58:03.572275 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-d5ced5bd-6a44-462b-8558-9be35b74901e tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:58:03.572721 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-d5ced5bd-6a44-462b-8558-9be35b74901e tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:58:03.573475 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-d5ced5bd-6a44-462b-8558-9be35b74901e tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:58:03.573910 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-d5ced5bd-6a44-462b-8558-9be35b74901e tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:58:03.588468 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.wsgi [None req-d5ced5bd-6a44-462b-8558-9be35b74901e tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] HTTP exception thrown: Instance ec6e78b4-5147-4f9b-84ce-c5d5ec0bd30d could not be found. Mar 05 02:58:03.589033 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-d5ced5bd-6a44-462b-8558-9be35b74901e tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Returning 404 to user: Instance ec6e78b4-5147-4f9b-84ce-c5d5ec0bd30d could not be found. {{(pid=123546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 02:58:03.589834 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-d5ced5bd-6a44-462b-8558-9be35b74901e tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] 10.222.0.26 "GET /compute/v2.1/servers/ec6e78b4-5147-4f9b-84ce-c5d5ec0bd30d" status: 404 len: 111 microversion: 2.1 time: 0.029160 Mar 05 02:58:03.590388 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 337/689] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:58:03 2022] GET /compute/v2.1/servers/ec6e78b4-5147-4f9b-84ce-c5d5ec0bd30d => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 05 02:58:03.599707 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-5239e3c3-c4c4-4327-9f89-54a185360f46 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Calling method '.version_select at 0x7f3f61cdadc0>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:58:03.618369 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-5239e3c3-c4c4-4327-9f89-54a185360f46 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1187777143" status: 202 len: 0 microversion: 2.1 time: 0.023381 Mar 05 02:58:03.618936 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 353/690] 10.222.0.26 () {58 vars in 1220 bytes} [Sat Mar 5 02:58:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1187777143 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 05 02:58:04.195706 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-3ffa29f6-3924-42f2-97bf-4531abfee530 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a1734e0f-4e20-4a56-b4f5-006f305d9a93"}} {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 02:58:04.196843 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-3ffa29f6-3924-42f2-97bf-4531abfee530 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] [instance: 4f97c839-ad1c-4b04-ac59-460b0de295ed] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:58:04.203524 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-3ffa29f6-3924-42f2-97bf-4531abfee530 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:58:04.204501 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-3ffa29f6-3924-42f2-97bf-4531abfee530 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:58:04.205231 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-3ffa29f6-3924-42f2-97bf-4531abfee530 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:58:04.205660 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-3ffa29f6-3924-42f2-97bf-4531abfee530 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:58:04.227128 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-2f5fa723-73fb-4556-805e-e117cad498cb tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Action: 'create', calling method: .version_select at 0x7f3f61ccfee0>, body: {"keypair": {"name": "tempest-keypair-1676234828"}} {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 02:58:04.242547 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.quota [None req-2f5fa723-73fb-4556-805e-e117cad498cb tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Getting quotas for project 3dd2b27540c04b4c8741ce8c9a5e2b47. Resources: {'key_pairs'} {{(pid=123545) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 02:58:04.246303 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.quota [None req-2f5fa723-73fb-4556-805e-e117cad498cb tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Getting quotas for user af8fb7f45f4d4eb180ccaca3d52ed2dc and project 3dd2b27540c04b4c8741ce8c9a5e2b47. Resources: {'key_pairs'} {{(pid=123545) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 02:58:04.436175 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.quota [None req-2f5fa723-73fb-4556-805e-e117cad498cb tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Getting quotas for project 3dd2b27540c04b4c8741ce8c9a5e2b47. Resources: {'key_pairs'} {{(pid=123545) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 02:58:04.440623 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.quota [None req-2f5fa723-73fb-4556-805e-e117cad498cb tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Getting quotas for user af8fb7f45f4d4eb180ccaca3d52ed2dc and project 3dd2b27540c04b4c8741ce8c9a5e2b47. Resources: {'key_pairs'} {{(pid=123545) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 02:58:04.446936 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-3ffa29f6-3924-42f2-97bf-4531abfee530 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] 10.222.0.26 "POST /compute/v2.1/servers/4f97c839-ad1c-4b04-ac59-460b0de295ed/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.254855 Mar 05 02:58:04.452186 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 338/691] 10.222.0.26 () {60 vars in 1322 bytes} [Sat Mar 5 02:58:04 2022] POST /compute/v2.1/servers/4f97c839-ad1c-4b04-ac59-460b0de295ed/os-volume_attachments => generated 194 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 02:58:04.458890 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-2f5fa723-73fb-4556-805e-e117cad498cb tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 2305 microversion: 2.1 time: 0.235599 Mar 05 02:58:04.459945 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 354/692] 10.222.0.26 () {60 vars in 1157 bytes} [Sat Mar 5 02:58:04 2022] POST /compute/v2.1/os-keypairs => generated 2305 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 02:58:05.690785 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-cb259c02-3c21-48ad-b4d3-e8ade2cc5879 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1209024745", "imageRef": "adbc7df1-116e-4f9f-a28d-a6a3c084cceb", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ea79f853-47ea-48eb-b063-dca7ecd22a4d"}], "security_groups": [{"name": "tempest-securitygroup--2136300168"}], "key_name": "tempest-keypair-1676234828", "user_data": "}} {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 02:58:05.789914 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.network.neutron [None req-cb259c02-3c21-48ad-b4d3-e8ade2cc5879 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] validate_networks() for [('ea79f853-47ea-48eb-b063-dca7ecd22a4d', None, None, None, None, None)] {{(pid=123546) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 05 02:58:06.155041 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.virt.hardware [None req-cb259c02-3c21-48ad-b4d3-e8ade2cc5879 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Flavor limits 0:0:0 {{(pid=123546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 05 02:58:06.155459 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.virt.hardware [None req-cb259c02-3c21-48ad-b4d3-e8ade2cc5879 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Image limits 0:0:0 {{(pid=123546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 05 02:58:06.155976 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.virt.hardware [None req-cb259c02-3c21-48ad-b4d3-e8ade2cc5879 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Flavor pref 0:0:0 {{(pid=123546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 05 02:58:06.156400 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.virt.hardware [None req-cb259c02-3c21-48ad-b4d3-e8ade2cc5879 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Image pref 0:0:0 {{(pid=123546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 05 02:58:06.156804 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.virt.hardware [None req-cb259c02-3c21-48ad-b4d3-e8ade2cc5879 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 05 02:58:06.165811 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-cb259c02-3c21-48ad-b4d3-e8ade2cc5879 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:58:06.166282 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-cb259c02-3c21-48ad-b4d3-e8ade2cc5879 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:58:06.167071 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-cb259c02-3c21-48ad-b4d3-e8ade2cc5879 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:58:06.167507 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-cb259c02-3c21-48ad-b4d3-e8ade2cc5879 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:58:06.184009 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.quota [None req-cb259c02-3c21-48ad-b4d3-e8ade2cc5879 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Getting quotas for project 3dd2b27540c04b4c8741ce8c9a5e2b47. Resources: {'ram', 'cores', 'instances'} {{(pid=123546) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 02:58:06.187823 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.quota [None req-cb259c02-3c21-48ad-b4d3-e8ade2cc5879 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Getting quotas for user af8fb7f45f4d4eb180ccaca3d52ed2dc and project 3dd2b27540c04b4c8741ce8c9a5e2b47. Resources: {'ram', 'cores', 'instances'} {{(pid=123546) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 02:58:06.198416 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-cb259c02-3c21-48ad-b4d3-e8ade2cc5879 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Going to run 1 instances... {{(pid=123546) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 05 02:58:06.200716 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-cb259c02-3c21-48ad-b4d3-e8ade2cc5879 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] [instance: 939b0cc0-f089-45e5-b1d4-c1117de03050] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='adbc7df1-116e-4f9f-a28d-a6a3c084cceb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123546) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 05 02:58:06.247057 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-cb259c02-3c21-48ad-b4d3-e8ade2cc5879 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.560988 Mar 05 02:58:06.247705 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 339/693] 10.222.0.26 () {60 vars in 1146 bytes} [Sat Mar 5 02:58:05 2022] POST /compute/v2.1/servers => generated 402 bytes in 562 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 05 02:58:06.258091 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-ed5c05e2-0aa5-4ad0-9de7-1a5a8c6d0687 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:58:06.258828 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-ed5c05e2-0aa5-4ad0-9de7-1a5a8c6d0687 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] [instance: 939b0cc0-f089-45e5-b1d4-c1117de03050] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:58:06.310016 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-ed5c05e2-0aa5-4ad0-9de7-1a5a8c6d0687 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af8fb7f45f4d4eb180ccaca3d52ed2dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dd2b27540c04b4c8741ce8c9a5e2b47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:58:06.316947 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-ed5c05e2-0aa5-4ad0-9de7-1a5a8c6d0687 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] 10.222.0.26 "GET /compute/v2.1/servers/939b0cc0-f089-45e5-b1d4-c1117de03050" status: 200 len: 1242 microversion: 2.1 time: 0.063090 Mar 05 02:58:06.317450 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 355/694] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:58:06 2022] GET /compute/v2.1/servers/939b0cc0-f089-45e5-b1d4-c1117de03050 => generated 1242 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 02:58:07.333663 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-a8bb67d9-f94f-45a4-aaa8-64be17d7f81b tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:58:07.334449 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-a8bb67d9-f94f-45a4-aaa8-64be17d7f81b tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] [instance: 939b0cc0-f089-45e5-b1d4-c1117de03050] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:58:07.341417 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-a8bb67d9-f94f-45a4-aaa8-64be17d7f81b tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:58:07.341874 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-a8bb67d9-f94f-45a4-aaa8-64be17d7f81b tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:58:07.342677 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-a8bb67d9-f94f-45a4-aaa8-64be17d7f81b tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:58:07.343118 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-a8bb67d9-f94f-45a4-aaa8-64be17d7f81b tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:58:07.408550 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-a8bb67d9-f94f-45a4-aaa8-64be17d7f81b tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af8fb7f45f4d4eb180ccaca3d52ed2dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dd2b27540c04b4c8741ce8c9a5e2b47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:58:07.415846 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-a8bb67d9-f94f-45a4-aaa8-64be17d7f81b tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] 10.222.0.26 "GET /compute/v2.1/servers/939b0cc0-f089-45e5-b1d4-c1117de03050" status: 200 len: 1300 microversion: 2.1 time: 0.087158 Mar 05 02:58:07.416423 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 340/695] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:58:07 2022] GET /compute/v2.1/servers/939b0cc0-f089-45e5-b1d4-c1117de03050 => generated 1300 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 02:58:08.432479 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-15b5c311-c6b0-4ddf-9d61-081cd63071b9 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:58:08.433088 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-15b5c311-c6b0-4ddf-9d61-081cd63071b9 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] [instance: 939b0cc0-f089-45e5-b1d4-c1117de03050] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:58:08.440609 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-15b5c311-c6b0-4ddf-9d61-081cd63071b9 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:58:08.441269 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-15b5c311-c6b0-4ddf-9d61-081cd63071b9 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:58:08.442624 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-15b5c311-c6b0-4ddf-9d61-081cd63071b9 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:58:08.444060 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-15b5c311-c6b0-4ddf-9d61-081cd63071b9 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:58:08.527812 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [req-516714b5-6133-4e5a-920c-eb42380af018 req-0f6b29f3-03d5-4ac1-889f-59449c474c8f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "939b0cc0-f089-45e5-b1d4-c1117de03050", "tag": "e4d5a4c8-f77f-4d45-9308-b37892288255"}]} {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 02:58:08.546543 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [req-516714b5-6133-4e5a-920c-eb42380af018 req-0f6b29f3-03d5-4ac1-889f-59449c474c8f service nova] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:58:08.547680 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [req-516714b5-6133-4e5a-920c-eb42380af018 req-0f6b29f3-03d5-4ac1-889f-59449c474c8f service nova] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:58:08.560600 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.compute.server_external_events [req-516714b5-6133-4e5a-920c-eb42380af018 req-0f6b29f3-03d5-4ac1-889f-59449c474c8f service nova] Creating event network-changed:e4d5a4c8-f77f-4d45-9308-b37892288255 for instance 939b0cc0-f089-45e5-b1d4-c1117de03050 on hv-cinder-82725 Mar 05 02:58:08.566803 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [req-516714b5-6133-4e5a-920c-eb42380af018 req-0f6b29f3-03d5-4ac1-889f-59449c474c8f service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045687 Mar 05 02:58:08.567562 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 341/696] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Mar 5 02:58:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 02:58:08.659233 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-15b5c311-c6b0-4ddf-9d61-081cd63071b9 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af8fb7f45f4d4eb180ccaca3d52ed2dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dd2b27540c04b4c8741ce8c9a5e2b47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:58:08.670663 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-15b5c311-c6b0-4ddf-9d61-081cd63071b9 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] 10.222.0.26 "GET /compute/v2.1/servers/939b0cc0-f089-45e5-b1d4-c1117de03050" status: 200 len: 1368 microversion: 2.1 time: 0.241944 Mar 05 02:58:08.671569 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 356/697] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:58:08 2022] GET /compute/v2.1/servers/939b0cc0-f089-45e5-b1d4-c1117de03050 => generated 1368 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 02:58:09.688844 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-9fecbedb-3aad-4e9a-8f01-80e24722092c tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:58:09.689525 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-9fecbedb-3aad-4e9a-8f01-80e24722092c tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] [instance: 939b0cc0-f089-45e5-b1d4-c1117de03050] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:58:09.695570 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-9fecbedb-3aad-4e9a-8f01-80e24722092c tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:58:09.696017 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-9fecbedb-3aad-4e9a-8f01-80e24722092c tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:58:09.696777 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-9fecbedb-3aad-4e9a-8f01-80e24722092c tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:58:09.697209 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-9fecbedb-3aad-4e9a-8f01-80e24722092c tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:58:09.831799 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-9fecbedb-3aad-4e9a-8f01-80e24722092c tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af8fb7f45f4d4eb180ccaca3d52ed2dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dd2b27540c04b4c8741ce8c9a5e2b47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:58:09.839240 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-9fecbedb-3aad-4e9a-8f01-80e24722092c tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] 10.222.0.26 "GET /compute/v2.1/servers/939b0cc0-f089-45e5-b1d4-c1117de03050" status: 200 len: 1368 microversion: 2.1 time: 0.155081 Mar 05 02:58:09.839819 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 342/698] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:58:09 2022] GET /compute/v2.1/servers/939b0cc0-f089-45e5-b1d4-c1117de03050 => generated 1368 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 02:58:10.856189 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-092ceec0-7fa1-42db-945c-011edea3725e tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:58:10.856854 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-092ceec0-7fa1-42db-945c-011edea3725e tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] [instance: 939b0cc0-f089-45e5-b1d4-c1117de03050] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:58:10.863943 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-092ceec0-7fa1-42db-945c-011edea3725e tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:58:10.864396 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-092ceec0-7fa1-42db-945c-011edea3725e tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:58:10.865206 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-092ceec0-7fa1-42db-945c-011edea3725e tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:58:10.865644 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-092ceec0-7fa1-42db-945c-011edea3725e tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:58:10.920889 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-62817b82-fa08-45fd-b526-67069fea2aed tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:58:10.921783 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-62817b82-fa08-45fd-b526-67069fea2aed tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] [instance: 4f97c839-ad1c-4b04-ac59-460b0de295ed] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:58:10.935500 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-62817b82-fa08-45fd-b526-67069fea2aed tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:58:10.936146 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-62817b82-fa08-45fd-b526-67069fea2aed tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:58:10.937082 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-62817b82-fa08-45fd-b526-67069fea2aed tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:58:10.937672 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-62817b82-fa08-45fd-b526-67069fea2aed tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:58:10.968174 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-62817b82-fa08-45fd-b526-67069fea2aed tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] 10.222.0.26 "GET /compute/v2.1/servers/4f97c839-ad1c-4b04-ac59-460b0de295ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053880 Mar 05 02:58:10.968747 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 343/699] 10.222.0.26 () {58 vars in 1301 bytes} [Sat Mar 5 02:58:10 2022] GET /compute/v2.1/servers/4f97c839-ad1c-4b04-ac59-460b0de295ed/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 05 02:58:10.979137 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-be77724f-a51a-4040-a0f6-9bf8a9e75587 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:58:10.979634 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-be77724f-a51a-4040-a0f6-9bf8a9e75587 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] [instance: 4f97c839-ad1c-4b04-ac59-460b0de295ed] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:58:10.986106 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-be77724f-a51a-4040-a0f6-9bf8a9e75587 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:58:10.986610 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-be77724f-a51a-4040-a0f6-9bf8a9e75587 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:58:10.987447 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-be77724f-a51a-4040-a0f6-9bf8a9e75587 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:58:10.987939 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-be77724f-a51a-4040-a0f6-9bf8a9e75587 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:58:11.016494 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-be77724f-a51a-4040-a0f6-9bf8a9e75587 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] 10.222.0.26 "GET /compute/v2.1/servers/4f97c839-ad1c-4b04-ac59-460b0de295ed/os-volume_attachments/a1734e0f-4e20-4a56-b4f5-006f305d9a93" status: 200 len: 194 microversion: 2.1 time: 0.041448 Mar 05 02:58:11.017136 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 344/700] 10.222.0.26 () {58 vars in 1412 bytes} [Sat Mar 5 02:58:10 2022] GET /compute/v2.1/servers/4f97c839-ad1c-4b04-ac59-460b0de295ed/os-volume_attachments/a1734e0f-4e20-4a56-b4f5-006f305d9a93 => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 02:58:11.017895 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-092ceec0-7fa1-42db-945c-011edea3725e tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af8fb7f45f4d4eb180ccaca3d52ed2dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dd2b27540c04b4c8741ce8c9a5e2b47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:58:11.025989 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-092ceec0-7fa1-42db-945c-011edea3725e tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] 10.222.0.26 "GET /compute/v2.1/servers/939b0cc0-f089-45e5-b1d4-c1117de03050" status: 200 len: 1368 microversion: 2.1 time: 0.173869 Mar 05 02:58:11.034620 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 357/701] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:58:10 2022] GET /compute/v2.1/servers/939b0cc0-f089-45e5-b1d4-c1117de03050 => generated 1368 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 02:58:12.042853 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-33c0acd7-38b2-451e-a16e-623c288ba268 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:58:12.043371 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-33c0acd7-38b2-451e-a16e-623c288ba268 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] [instance: 939b0cc0-f089-45e5-b1d4-c1117de03050] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:58:12.049858 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-33c0acd7-38b2-451e-a16e-623c288ba268 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:58:12.050335 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-33c0acd7-38b2-451e-a16e-623c288ba268 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:58:12.051093 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-33c0acd7-38b2-451e-a16e-623c288ba268 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:58:12.051523 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-33c0acd7-38b2-451e-a16e-623c288ba268 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:58:12.180443 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-33c0acd7-38b2-451e-a16e-623c288ba268 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af8fb7f45f4d4eb180ccaca3d52ed2dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dd2b27540c04b4c8741ce8c9a5e2b47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:58:12.187507 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-33c0acd7-38b2-451e-a16e-623c288ba268 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] 10.222.0.26 "GET /compute/v2.1/servers/939b0cc0-f089-45e5-b1d4-c1117de03050" status: 200 len: 1368 microversion: 2.1 time: 0.148579 Mar 05 02:58:12.188071 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 345/702] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:58:12 2022] GET /compute/v2.1/servers/939b0cc0-f089-45e5-b1d4-c1117de03050 => generated 1368 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 02:58:12.328487 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-4bdb0476-b250-4eae-bd5a-dae27a57c652 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "eece09dd-26e0-4ce2-883c-a0acfe4571f8"}} {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 02:58:12.330148 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-4bdb0476-b250-4eae-bd5a-dae27a57c652 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] [instance: 4f97c839-ad1c-4b04-ac59-460b0de295ed] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:58:12.336430 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-4bdb0476-b250-4eae-bd5a-dae27a57c652 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:58:12.336874 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-4bdb0476-b250-4eae-bd5a-dae27a57c652 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:58:12.337637 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-4bdb0476-b250-4eae-bd5a-dae27a57c652 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:58:12.338097 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-4bdb0476-b250-4eae-bd5a-dae27a57c652 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:58:12.595624 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-4bdb0476-b250-4eae-bd5a-dae27a57c652 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] 10.222.0.26 "POST /compute/v2.1/servers/4f97c839-ad1c-4b04-ac59-460b0de295ed/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.270267 Mar 05 02:58:12.597084 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 358/703] 10.222.0.26 () {60 vars in 1322 bytes} [Sat Mar 5 02:58:12 2022] POST /compute/v2.1/servers/4f97c839-ad1c-4b04-ac59-460b0de295ed/os-volume_attachments => generated 194 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 02:58:12.733790 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [req-0d16312c-8da6-4eb1-8995-21ba7e4102d6 req-ca21683e-6f36-4db9-b079-d01cdb49415f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "939b0cc0-f089-45e5-b1d4-c1117de03050", "name": "network-vif-plugged", "status": "completed", "tag": "e4d5a4c8-f77f-4d45-9308-b37892288255"}]} {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 02:58:12.743346 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [req-0d16312c-8da6-4eb1-8995-21ba7e4102d6 req-ca21683e-6f36-4db9-b079-d01cdb49415f service nova] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:58:12.744059 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [req-0d16312c-8da6-4eb1-8995-21ba7e4102d6 req-ca21683e-6f36-4db9-b079-d01cdb49415f service nova] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:58:12.760581 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.compute.server_external_events [req-0d16312c-8da6-4eb1-8995-21ba7e4102d6 req-ca21683e-6f36-4db9-b079-d01cdb49415f service nova] Creating event network-vif-plugged:e4d5a4c8-f77f-4d45-9308-b37892288255 for instance 939b0cc0-f089-45e5-b1d4-c1117de03050 on hv-cinder-82725 Mar 05 02:58:12.765718 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [req-0d16312c-8da6-4eb1-8995-21ba7e4102d6 req-ca21683e-6f36-4db9-b079-d01cdb49415f service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036047 Mar 05 02:58:12.767520 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 346/704] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Mar 5 02:58:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 02:58:13.206356 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-33790c0d-9373-4b80-810d-0dedd2fe954f tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:58:13.207044 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-33790c0d-9373-4b80-810d-0dedd2fe954f tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] [instance: 939b0cc0-f089-45e5-b1d4-c1117de03050] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:58:13.213584 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-33790c0d-9373-4b80-810d-0dedd2fe954f tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:58:13.214057 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-33790c0d-9373-4b80-810d-0dedd2fe954f tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:58:13.214815 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-33790c0d-9373-4b80-810d-0dedd2fe954f tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:58:13.215245 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-33790c0d-9373-4b80-810d-0dedd2fe954f tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:58:13.348888 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-33790c0d-9373-4b80-810d-0dedd2fe954f tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af8fb7f45f4d4eb180ccaca3d52ed2dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dd2b27540c04b4c8741ce8c9a5e2b47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:58:13.356356 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-33790c0d-9373-4b80-810d-0dedd2fe954f tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] 10.222.0.26 "GET /compute/v2.1/servers/939b0cc0-f089-45e5-b1d4-c1117de03050" status: 200 len: 1368 microversion: 2.1 time: 0.155396 Mar 05 02:58:13.356915 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 359/705] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:58:13 2022] GET /compute/v2.1/servers/939b0cc0-f089-45e5-b1d4-c1117de03050 => generated 1368 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 02:58:14.373698 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-c482c272-b3c7-44d8-97e6-75d281899ed4 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:58:14.374432 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-c482c272-b3c7-44d8-97e6-75d281899ed4 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] [instance: 939b0cc0-f089-45e5-b1d4-c1117de03050] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:58:14.381205 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-c482c272-b3c7-44d8-97e6-75d281899ed4 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:58:14.381673 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-c482c272-b3c7-44d8-97e6-75d281899ed4 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:58:14.382482 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-c482c272-b3c7-44d8-97e6-75d281899ed4 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:58:14.382921 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-c482c272-b3c7-44d8-97e6-75d281899ed4 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:58:14.512733 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-c482c272-b3c7-44d8-97e6-75d281899ed4 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af8fb7f45f4d4eb180ccaca3d52ed2dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dd2b27540c04b4c8741ce8c9a5e2b47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:58:14.520081 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-c482c272-b3c7-44d8-97e6-75d281899ed4 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] 10.222.0.26 "GET /compute/v2.1/servers/939b0cc0-f089-45e5-b1d4-c1117de03050" status: 200 len: 1558 microversion: 2.1 time: 0.150777 Mar 05 02:58:14.520652 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 347/706] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:58:14 2022] GET /compute/v2.1/servers/939b0cc0-f089-45e5-b1d4-c1117de03050 => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 02:58:14.536427 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-83fe72fc-b6a3-46e3-94b8-8f3d1a85522d tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:58:14.536934 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-83fe72fc-b6a3-46e3-94b8-8f3d1a85522d tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] [instance: 939b0cc0-f089-45e5-b1d4-c1117de03050] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:58:14.543044 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-83fe72fc-b6a3-46e3-94b8-8f3d1a85522d tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:58:14.543488 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-83fe72fc-b6a3-46e3-94b8-8f3d1a85522d tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:58:14.544246 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-83fe72fc-b6a3-46e3-94b8-8f3d1a85522d tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:58:14.544675 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-83fe72fc-b6a3-46e3-94b8-8f3d1a85522d tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:58:14.630007 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-83fe72fc-b6a3-46e3-94b8-8f3d1a85522d tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] 10.222.0.26 "GET /compute/v2.1/servers/939b0cc0-f089-45e5-b1d4-c1117de03050/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.097806 Mar 05 02:58:14.630606 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 360/707] 10.222.0.26 () {58 vars in 1274 bytes} [Sat Mar 5 02:58:14 2022] GET /compute/v2.1/servers/939b0cc0-f089-45e5-b1d4-c1117de03050/os-interface => generated 285 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 02:58:15.636765 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [req-9cb4922e-1cbb-405f-9f19-f4efb4515a1f req-cbd01590-a277-4ef0-aa15-327cb3c4fe2d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "939b0cc0-f089-45e5-b1d4-c1117de03050", "tag": "e4d5a4c8-f77f-4d45-9308-b37892288255"}]} {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 02:58:15.644752 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [req-9cb4922e-1cbb-405f-9f19-f4efb4515a1f req-cbd01590-a277-4ef0-aa15-327cb3c4fe2d service nova] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:58:15.645196 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [req-9cb4922e-1cbb-405f-9f19-f4efb4515a1f req-cbd01590-a277-4ef0-aa15-327cb3c4fe2d service nova] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:58:15.655650 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.compute.server_external_events [req-9cb4922e-1cbb-405f-9f19-f4efb4515a1f req-cbd01590-a277-4ef0-aa15-327cb3c4fe2d service nova] Creating event network-changed:e4d5a4c8-f77f-4d45-9308-b37892288255 for instance 939b0cc0-f089-45e5-b1d4-c1117de03050 on hv-cinder-82725 Mar 05 02:58:15.661093 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [req-9cb4922e-1cbb-405f-9f19-f4efb4515a1f req-cbd01590-a277-4ef0-aa15-327cb3c4fe2d service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082280 Mar 05 02:58:15.661684 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 348/708] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Mar 5 02:58:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 02:58:20.093810 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-af3f7d07-0ec6-4e75-b454-0b50ecfcdad7 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:58:20.094779 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-af3f7d07-0ec6-4e75-b454-0b50ecfcdad7 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] [instance: 4f97c839-ad1c-4b04-ac59-460b0de295ed] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:58:20.101352 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-af3f7d07-0ec6-4e75-b454-0b50ecfcdad7 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:58:20.101803 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-af3f7d07-0ec6-4e75-b454-0b50ecfcdad7 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:58:20.102599 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-af3f7d07-0ec6-4e75-b454-0b50ecfcdad7 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:58:20.103293 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-af3f7d07-0ec6-4e75-b454-0b50ecfcdad7 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:58:20.131442 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-af3f7d07-0ec6-4e75-b454-0b50ecfcdad7 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] 10.222.0.26 "GET /compute/v2.1/servers/4f97c839-ad1c-4b04-ac59-460b0de295ed/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042003 Mar 05 02:58:20.131986 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 361/709] 10.222.0.26 () {58 vars in 1301 bytes} [Sat Mar 5 02:58:20 2022] GET /compute/v2.1/servers/4f97c839-ad1c-4b04-ac59-460b0de295ed/os-volume_attachments => generated 371 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 02:58:20.250585 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-89820146-f9ef-4944-adcc-fe556670fbe8 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:58:20.251125 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-89820146-f9ef-4944-adcc-fe556670fbe8 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] [instance: 4f97c839-ad1c-4b04-ac59-460b0de295ed] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:58:20.257770 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-89820146-f9ef-4944-adcc-fe556670fbe8 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:58:20.258262 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-89820146-f9ef-4944-adcc-fe556670fbe8 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:58:20.259033 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-89820146-f9ef-4944-adcc-fe556670fbe8 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:58:20.259473 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-89820146-f9ef-4944-adcc-fe556670fbe8 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:58:20.287920 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-89820146-f9ef-4944-adcc-fe556670fbe8 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] 10.222.0.26 "GET /compute/v2.1/servers/4f97c839-ad1c-4b04-ac59-460b0de295ed/os-volume_attachments/a1734e0f-4e20-4a56-b4f5-006f305d9a93" status: 200 len: 194 microversion: 2.1 time: 0.042209 Mar 05 02:58:20.288496 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 349/710] 10.222.0.26 () {58 vars in 1412 bytes} [Sat Mar 5 02:58:20 2022] GET /compute/v2.1/servers/4f97c839-ad1c-4b04-ac59-460b0de295ed/os-volume_attachments/a1734e0f-4e20-4a56-b4f5-006f305d9a93 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 02:58:20.297877 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-cefa5f78-01ca-4170-8b57-e09ad09860b3 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:58:20.298401 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-cefa5f78-01ca-4170-8b57-e09ad09860b3 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] [instance: 4f97c839-ad1c-4b04-ac59-460b0de295ed] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:58:20.304223 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-cefa5f78-01ca-4170-8b57-e09ad09860b3 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:58:20.304677 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-cefa5f78-01ca-4170-8b57-e09ad09860b3 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:58:20.305446 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-cefa5f78-01ca-4170-8b57-e09ad09860b3 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:58:20.305888 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-cefa5f78-01ca-4170-8b57-e09ad09860b3 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:58:20.382049 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.objects.instance [None req-cefa5f78-01ca-4170-8b57-e09ad09860b3 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lazy-loading 'services' on Instance uuid 4f97c839-ad1c-4b04-ac59-460b0de295ed {{(pid=123545) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 05 02:58:20.449491 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-cefa5f78-01ca-4170-8b57-e09ad09860b3 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] 10.222.0.26 "DELETE /compute/v2.1/servers/4f97c839-ad1c-4b04-ac59-460b0de295ed/os-volume_attachments/a1734e0f-4e20-4a56-b4f5-006f305d9a93" status: 202 len: 0 microversion: 2.1 time: 0.155302 Mar 05 02:58:20.450105 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 362/711] 10.222.0.26 () {58 vars in 1415 bytes} [Sat Mar 5 02:58:20 2022] DELETE /compute/v2.1/servers/4f97c839-ad1c-4b04-ac59-460b0de295ed/os-volume_attachments/a1734e0f-4e20-4a56-b4f5-006f305d9a93 => generated 0 bytes in 157 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 05 02:58:21.557871 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-8086b678-23dd-40ab-94a9-a9c15edd9ded tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:58:21.558464 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-8086b678-23dd-40ab-94a9-a9c15edd9ded tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] [instance: 4f97c839-ad1c-4b04-ac59-460b0de295ed] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:58:21.564613 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-8086b678-23dd-40ab-94a9-a9c15edd9ded tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:58:21.565061 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-8086b678-23dd-40ab-94a9-a9c15edd9ded tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:58:21.565827 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-8086b678-23dd-40ab-94a9-a9c15edd9ded tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:58:21.566295 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-8086b678-23dd-40ab-94a9-a9c15edd9ded tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:58:21.594392 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-8086b678-23dd-40ab-94a9-a9c15edd9ded tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] 10.222.0.26 "GET /compute/v2.1/servers/4f97c839-ad1c-4b04-ac59-460b0de295ed/os-volume_attachments/eece09dd-26e0-4ce2-883c-a0acfe4571f8" status: 200 len: 194 microversion: 2.1 time: 0.040373 Mar 05 02:58:21.594985 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 350/712] 10.222.0.26 () {58 vars in 1412 bytes} [Sat Mar 5 02:58:21 2022] GET /compute/v2.1/servers/4f97c839-ad1c-4b04-ac59-460b0de295ed/os-volume_attachments/eece09dd-26e0-4ce2-883c-a0acfe4571f8 => generated 194 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 02:58:21.606018 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-dc2785e2-68c7-49d4-a0ce-a38969c3c945 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:58:21.606594 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-dc2785e2-68c7-49d4-a0ce-a38969c3c945 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] [instance: 4f97c839-ad1c-4b04-ac59-460b0de295ed] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:58:21.613067 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-dc2785e2-68c7-49d4-a0ce-a38969c3c945 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:58:21.613512 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-dc2785e2-68c7-49d4-a0ce-a38969c3c945 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:58:21.614295 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-dc2785e2-68c7-49d4-a0ce-a38969c3c945 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:58:21.614842 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-dc2785e2-68c7-49d4-a0ce-a38969c3c945 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:58:21.692573 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.objects.instance [None req-dc2785e2-68c7-49d4-a0ce-a38969c3c945 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lazy-loading 'services' on Instance uuid 4f97c839-ad1c-4b04-ac59-460b0de295ed {{(pid=123545) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 05 02:58:21.760581 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-dc2785e2-68c7-49d4-a0ce-a38969c3c945 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] 10.222.0.26 "DELETE /compute/v2.1/servers/4f97c839-ad1c-4b04-ac59-460b0de295ed/os-volume_attachments/eece09dd-26e0-4ce2-883c-a0acfe4571f8" status: 202 len: 0 microversion: 2.1 time: 0.158946 Mar 05 02:58:21.761164 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 363/713] 10.222.0.26 () {58 vars in 1415 bytes} [Sat Mar 5 02:58:21 2022] DELETE /compute/v2.1/servers/4f97c839-ad1c-4b04-ac59-460b0de295ed/os-volume_attachments/eece09dd-26e0-4ce2-883c-a0acfe4571f8 => generated 0 bytes in 160 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 05 02:58:22.919016 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-01fe5577-c96f-4cd0-8bbb-37130f599c07 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:58:22.920016 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-01fe5577-c96f-4cd0-8bbb-37130f599c07 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] [instance: 4f97c839-ad1c-4b04-ac59-460b0de295ed] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:58:22.926891 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-01fe5577-c96f-4cd0-8bbb-37130f599c07 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:58:22.927389 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-01fe5577-c96f-4cd0-8bbb-37130f599c07 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:58:22.928241 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-01fe5577-c96f-4cd0-8bbb-37130f599c07 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:58:22.928738 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-01fe5577-c96f-4cd0-8bbb-37130f599c07 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:58:22.957788 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-01fe5577-c96f-4cd0-8bbb-37130f599c07 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] 10.222.0.26 "GET /compute/v2.1/servers/4f97c839-ad1c-4b04-ac59-460b0de295ed/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042902 Mar 05 02:58:22.958388 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 351/714] 10.222.0.26 () {58 vars in 1301 bytes} [Sat Mar 5 02:58:22 2022] GET /compute/v2.1/servers/4f97c839-ad1c-4b04-ac59-460b0de295ed/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 05 02:58:23.059961 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-aa8404b9-61eb-4612-bd69-809ddee984da tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:58:23.061003 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-aa8404b9-61eb-4612-bd69-809ddee984da tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] [instance: 4f97c839-ad1c-4b04-ac59-460b0de295ed] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:58:23.067853 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-aa8404b9-61eb-4612-bd69-809ddee984da tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:58:23.068297 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-aa8404b9-61eb-4612-bd69-809ddee984da tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:58:23.069055 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-aa8404b9-61eb-4612-bd69-809ddee984da tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:58:23.069495 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-aa8404b9-61eb-4612-bd69-809ddee984da tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:58:23.097539 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-aa8404b9-61eb-4612-bd69-809ddee984da tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] 10.222.0.26 "GET /compute/v2.1/servers/4f97c839-ad1c-4b04-ac59-460b0de295ed/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041791 Mar 05 02:58:23.098097 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 364/715] 10.222.0.26 () {58 vars in 1301 bytes} [Sat Mar 5 02:58:23 2022] GET /compute/v2.1/servers/4f97c839-ad1c-4b04-ac59-460b0de295ed/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 05 02:58:23.152831 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-4aa8d430-4733-4c65-841b-1de0b5aa2f2b tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:58:23.153321 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-4aa8d430-4733-4c65-841b-1de0b5aa2f2b tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] [instance: 4f97c839-ad1c-4b04-ac59-460b0de295ed] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:58:23.159783 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-4aa8d430-4733-4c65-841b-1de0b5aa2f2b tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:58:23.160227 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-4aa8d430-4733-4c65-841b-1de0b5aa2f2b tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:58:23.160990 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-4aa8d430-4733-4c65-841b-1de0b5aa2f2b tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:58:23.161427 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-4aa8d430-4733-4c65-841b-1de0b5aa2f2b tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:58:23.184169 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-4aa8d430-4733-4c65-841b-1de0b5aa2f2b tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] [instance: 4f97c839-ad1c-4b04-ac59-460b0de295ed] Going to try to terminate instance {{(pid=123546) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 05 02:58:23.259376 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-4aa8d430-4733-4c65-841b-1de0b5aa2f2b tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] 10.222.0.26 "DELETE /compute/v2.1/servers/4f97c839-ad1c-4b04-ac59-460b0de295ed" status: 204 len: 0 microversion: 2.1 time: 0.109988 Mar 05 02:58:23.260016 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 352/716] 10.222.0.26 () {58 vars in 1238 bytes} [Sat Mar 5 02:58:23 2022] DELETE /compute/v2.1/servers/4f97c839-ad1c-4b04-ac59-460b0de295ed => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 05 02:58:23.269494 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-081f2ea5-750a-40a2-a722-12a4419077bb tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:58:23.270135 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-081f2ea5-750a-40a2-a722-12a4419077bb tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] [instance: 4f97c839-ad1c-4b04-ac59-460b0de295ed] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:58:23.275905 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-081f2ea5-750a-40a2-a722-12a4419077bb tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:58:23.276351 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-081f2ea5-750a-40a2-a722-12a4419077bb tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:58:23.277108 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-081f2ea5-750a-40a2-a722-12a4419077bb tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:58:23.277537 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-081f2ea5-750a-40a2-a722-12a4419077bb tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:58:23.407459 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-081f2ea5-750a-40a2-a722-12a4419077bb tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e5a000087fe40419ccd0d1a96fb4783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9d27da2e71d4962a53a95efc46518ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:58:23.414916 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-081f2ea5-750a-40a2-a722-12a4419077bb tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] 10.222.0.26 "GET /compute/v2.1/servers/4f97c839-ad1c-4b04-ac59-460b0de295ed" status: 200 len: 1674 microversion: 2.1 time: 0.149999 Mar 05 02:58:23.415477 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 365/717] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:58:23 2022] GET /compute/v2.1/servers/4f97c839-ad1c-4b04-ac59-460b0de295ed => generated 1674 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 02:58:24.432404 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-fd52d55c-8854-4ee3-a90a-afd678f6fd7f tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:58:24.433102 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-fd52d55c-8854-4ee3-a90a-afd678f6fd7f tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] [instance: 4f97c839-ad1c-4b04-ac59-460b0de295ed] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:58:24.440140 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-fd52d55c-8854-4ee3-a90a-afd678f6fd7f tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:58:24.440595 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-fd52d55c-8854-4ee3-a90a-afd678f6fd7f tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:58:24.441375 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-fd52d55c-8854-4ee3-a90a-afd678f6fd7f tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:58:24.441844 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-fd52d55c-8854-4ee3-a90a-afd678f6fd7f tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:58:24.587521 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-fd52d55c-8854-4ee3-a90a-afd678f6fd7f tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e5a000087fe40419ccd0d1a96fb4783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9d27da2e71d4962a53a95efc46518ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:58:24.595433 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-fd52d55c-8854-4ee3-a90a-afd678f6fd7f tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] 10.222.0.26 "GET /compute/v2.1/servers/4f97c839-ad1c-4b04-ac59-460b0de295ed" status: 200 len: 1674 microversion: 2.1 time: 0.167217 Mar 05 02:58:24.596081 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 353/718] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:58:24 2022] GET /compute/v2.1/servers/4f97c839-ad1c-4b04-ac59-460b0de295ed => generated 1674 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 02:58:25.613794 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-ae5959f1-7416-41ef-a605-b8525c930b07 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:58:25.614504 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-ae5959f1-7416-41ef-a605-b8525c930b07 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] [instance: 4f97c839-ad1c-4b04-ac59-460b0de295ed] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:58:25.621791 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-ae5959f1-7416-41ef-a605-b8525c930b07 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:58:25.622267 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-ae5959f1-7416-41ef-a605-b8525c930b07 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:58:25.623061 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-ae5959f1-7416-41ef-a605-b8525c930b07 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:58:25.623493 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-ae5959f1-7416-41ef-a605-b8525c930b07 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:58:25.841002 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-ae5959f1-7416-41ef-a605-b8525c930b07 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e5a000087fe40419ccd0d1a96fb4783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9d27da2e71d4962a53a95efc46518ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:58:25.849410 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-ae5959f1-7416-41ef-a605-b8525c930b07 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] 10.222.0.26 "GET /compute/v2.1/servers/4f97c839-ad1c-4b04-ac59-460b0de295ed" status: 200 len: 1674 microversion: 2.1 time: 0.240130 Mar 05 02:58:25.850110 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 366/719] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:58:25 2022] GET /compute/v2.1/servers/4f97c839-ad1c-4b04-ac59-460b0de295ed => generated 1674 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 02:58:26.177117 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [req-5665baae-db5c-456b-846a-e6092feb939c req-eb70fc9a-7042-4a9b-a5a9-9898604dacad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f97c839-ad1c-4b04-ac59-460b0de295ed", "name": "network-vif-deleted", "tag": "00972e01-aaaf-4d40-a722-75829a58b00f"}]} {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 02:58:26.186245 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [req-5665baae-db5c-456b-846a-e6092feb939c req-eb70fc9a-7042-4a9b-a5a9-9898604dacad service nova] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:58:26.186690 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [req-5665baae-db5c-456b-846a-e6092feb939c req-eb70fc9a-7042-4a9b-a5a9-9898604dacad service nova] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:58:26.199207 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.compute.server_external_events [req-5665baae-db5c-456b-846a-e6092feb939c req-eb70fc9a-7042-4a9b-a5a9-9898604dacad service nova] Creating event network-vif-deleted:00972e01-aaaf-4d40-a722-75829a58b00f for instance 4f97c839-ad1c-4b04-ac59-460b0de295ed on hv-cinder-82725 Mar 05 02:58:26.204974 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [req-5665baae-db5c-456b-846a-e6092feb939c req-eb70fc9a-7042-4a9b-a5a9-9898604dacad service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031080 Mar 05 02:58:26.205825 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 354/720] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Mar 5 02:58:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 02:58:26.868117 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-861523aa-559b-462e-97e5-f8dd65d46f26 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:58:26.868767 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-861523aa-559b-462e-97e5-f8dd65d46f26 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] [instance: 4f97c839-ad1c-4b04-ac59-460b0de295ed] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:58:26.875524 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-861523aa-559b-462e-97e5-f8dd65d46f26 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:58:26.875979 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-861523aa-559b-462e-97e5-f8dd65d46f26 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:58:26.877366 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-861523aa-559b-462e-97e5-f8dd65d46f26 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:58:26.877806 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-861523aa-559b-462e-97e5-f8dd65d46f26 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:58:26.892900 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.wsgi [None req-861523aa-559b-462e-97e5-f8dd65d46f26 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] HTTP exception thrown: Instance 4f97c839-ad1c-4b04-ac59-460b0de295ed could not be found. Mar 05 02:58:26.893583 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-861523aa-559b-462e-97e5-f8dd65d46f26 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Returning 404 to user: Instance 4f97c839-ad1c-4b04-ac59-460b0de295ed could not be found. {{(pid=123545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 02:58:26.894601 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-861523aa-559b-462e-97e5-f8dd65d46f26 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] 10.222.0.26 "GET /compute/v2.1/servers/4f97c839-ad1c-4b04-ac59-460b0de295ed" status: 404 len: 111 microversion: 2.1 time: 0.030424 Mar 05 02:58:26.895482 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 367/721] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:58:26 2022] GET /compute/v2.1/servers/4f97c839-ad1c-4b04-ac59-460b0de295ed => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 05 02:58:26.904351 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-06f34829-7ab2-4d3c-9bb5-791f8c3f46e4 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Calling method '.version_select at 0x7f3f61dfe0d0>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:58:26.922495 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-06f34829-7ab2-4d3c-9bb5-791f8c3f46e4 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-935484592" status: 202 len: 0 microversion: 2.1 time: 0.022292 Mar 05 02:58:26.923081 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 355/722] 10.222.0.26 () {58 vars in 1217 bytes} [Sat Mar 5 02:58:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-935484592 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 05 02:58:29.796779 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-42446588-7a8d-4fcf-99ef-bcdbfadfd12b tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:58:29.797276 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-42446588-7a8d-4fcf-99ef-bcdbfadfd12b tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] [instance: 4f97c839-ad1c-4b04-ac59-460b0de295ed] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:58:29.804216 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-42446588-7a8d-4fcf-99ef-bcdbfadfd12b tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:58:29.804658 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-42446588-7a8d-4fcf-99ef-bcdbfadfd12b tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:58:29.805415 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-42446588-7a8d-4fcf-99ef-bcdbfadfd12b tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:58:29.805847 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-42446588-7a8d-4fcf-99ef-bcdbfadfd12b tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:58:29.819426 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.wsgi [None req-42446588-7a8d-4fcf-99ef-bcdbfadfd12b tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] HTTP exception thrown: Instance 4f97c839-ad1c-4b04-ac59-460b0de295ed could not be found. Mar 05 02:58:29.819999 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-42446588-7a8d-4fcf-99ef-bcdbfadfd12b tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Returning 404 to user: Instance 4f97c839-ad1c-4b04-ac59-460b0de295ed could not be found. {{(pid=123545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 02:58:29.820802 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-42446588-7a8d-4fcf-99ef-bcdbfadfd12b tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] 10.222.0.26 "DELETE /compute/v2.1/servers/4f97c839-ad1c-4b04-ac59-460b0de295ed" status: 404 len: 111 microversion: 2.1 time: 0.027865 Mar 05 02:58:29.821325 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 368/723] 10.222.0.26 () {58 vars in 1238 bytes} [Sat Mar 5 02:58:29 2022] DELETE /compute/v2.1/servers/4f97c839-ad1c-4b04-ac59-460b0de295ed => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 05 02:58:29.829785 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-0a9f2d70-4c7b-4918-9fb3-f668e4147e16 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:58:29.830552 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-0a9f2d70-4c7b-4918-9fb3-f668e4147e16 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] [instance: 4f97c839-ad1c-4b04-ac59-460b0de295ed] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:58:29.836570 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-0a9f2d70-4c7b-4918-9fb3-f668e4147e16 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:58:29.837025 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-0a9f2d70-4c7b-4918-9fb3-f668e4147e16 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:58:29.837790 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-0a9f2d70-4c7b-4918-9fb3-f668e4147e16 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:58:29.838270 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-0a9f2d70-4c7b-4918-9fb3-f668e4147e16 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:58:29.851321 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.wsgi [None req-0a9f2d70-4c7b-4918-9fb3-f668e4147e16 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] HTTP exception thrown: Instance 4f97c839-ad1c-4b04-ac59-460b0de295ed could not be found. Mar 05 02:58:29.851897 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-0a9f2d70-4c7b-4918-9fb3-f668e4147e16 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Returning 404 to user: Instance 4f97c839-ad1c-4b04-ac59-460b0de295ed could not be found. {{(pid=123546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 02:58:29.852957 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-0a9f2d70-4c7b-4918-9fb3-f668e4147e16 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] 10.222.0.26 "GET /compute/v2.1/servers/4f97c839-ad1c-4b04-ac59-460b0de295ed" status: 404 len: 111 microversion: 2.1 time: 0.027413 Mar 05 02:58:29.853483 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 356/724] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:58:29 2022] GET /compute/v2.1/servers/4f97c839-ad1c-4b04-ac59-460b0de295ed => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 05 02:58:30.981166 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-da808cc0-a06d-4328-913c-0f433810c43f tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:58:30.981694 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-da808cc0-a06d-4328-913c-0f433810c43f tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] [instance: d0080e4b-6532-4e0c-8d19-cfbdf32e401b] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:58:30.987989 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-da808cc0-a06d-4328-913c-0f433810c43f tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:58:30.988437 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-da808cc0-a06d-4328-913c-0f433810c43f tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:58:30.989229 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-da808cc0-a06d-4328-913c-0f433810c43f tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:58:30.989685 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-da808cc0-a06d-4328-913c-0f433810c43f tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:58:31.003340 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.wsgi [None req-da808cc0-a06d-4328-913c-0f433810c43f tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] HTTP exception thrown: Instance d0080e4b-6532-4e0c-8d19-cfbdf32e401b could not be found. Mar 05 02:58:31.003914 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-da808cc0-a06d-4328-913c-0f433810c43f tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Returning 404 to user: Instance d0080e4b-6532-4e0c-8d19-cfbdf32e401b could not be found. {{(pid=123545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 02:58:31.004710 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-da808cc0-a06d-4328-913c-0f433810c43f tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] 10.222.0.26 "DELETE /compute/v2.1/servers/d0080e4b-6532-4e0c-8d19-cfbdf32e401b" status: 404 len: 111 microversion: 2.1 time: 0.027670 Mar 05 02:58:31.005222 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 369/725] 10.222.0.26 () {58 vars in 1238 bytes} [Sat Mar 5 02:58:30 2022] DELETE /compute/v2.1/servers/d0080e4b-6532-4e0c-8d19-cfbdf32e401b => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 05 02:58:31.013051 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-7b6d92a3-cc41-41a0-a204-22d96e88b4b1 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:58:31.013669 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-7b6d92a3-cc41-41a0-a204-22d96e88b4b1 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] [instance: d0080e4b-6532-4e0c-8d19-cfbdf32e401b] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:58:31.020542 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-7b6d92a3-cc41-41a0-a204-22d96e88b4b1 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:58:31.021000 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-7b6d92a3-cc41-41a0-a204-22d96e88b4b1 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:58:31.021764 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-7b6d92a3-cc41-41a0-a204-22d96e88b4b1 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:58:31.022243 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-7b6d92a3-cc41-41a0-a204-22d96e88b4b1 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:58:31.035371 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.wsgi [None req-7b6d92a3-cc41-41a0-a204-22d96e88b4b1 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] HTTP exception thrown: Instance d0080e4b-6532-4e0c-8d19-cfbdf32e401b could not be found. Mar 05 02:58:31.035944 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-7b6d92a3-cc41-41a0-a204-22d96e88b4b1 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] Returning 404 to user: Instance d0080e4b-6532-4e0c-8d19-cfbdf32e401b could not be found. {{(pid=123546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 02:58:31.036746 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-7b6d92a3-cc41-41a0-a204-22d96e88b4b1 tempest-AttachVolumeTestJSON-150925167 tempest-AttachVolumeTestJSON-150925167-project] 10.222.0.26 "GET /compute/v2.1/servers/d0080e4b-6532-4e0c-8d19-cfbdf32e401b" status: 404 len: 111 microversion: 2.1 time: 0.027653 Mar 05 02:58:31.037264 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 357/726] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:58:31 2022] GET /compute/v2.1/servers/d0080e4b-6532-4e0c-8d19-cfbdf32e401b => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 05 02:58:34.046609 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-0aa4d70d-b9cf-4310-80fc-65b38626bbc4 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:58:34.047494 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-0aa4d70d-b9cf-4310-80fc-65b38626bbc4 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] [instance: 1b31d7bf-888c-45a2-bc3a-e7077ad3a96d] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:58:34.054531 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-0aa4d70d-b9cf-4310-80fc-65b38626bbc4 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:58:34.055427 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-0aa4d70d-b9cf-4310-80fc-65b38626bbc4 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:58:34.057088 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-0aa4d70d-b9cf-4310-80fc-65b38626bbc4 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:58:34.058252 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-0aa4d70d-b9cf-4310-80fc-65b38626bbc4 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:58:34.089051 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-0aa4d70d-b9cf-4310-80fc-65b38626bbc4 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] 10.222.0.26 "GET /compute/v2.1/servers/1b31d7bf-888c-45a2-bc3a-e7077ad3a96d/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.046198 Mar 05 02:58:34.089736 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 370/727] 10.222.0.26 () {60 vars in 1342 bytes} [Sat Mar 5 02:58:34 2022] GET /compute/v2.1/servers/1b31d7bf-888c-45a2-bc3a-e7077ad3a96d/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 02:58:34.170479 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-deb422b5-12fe-403a-a1e9-cc9d186e1706 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:58:34.170986 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-deb422b5-12fe-403a-a1e9-cc9d186e1706 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] [instance: 1b31d7bf-888c-45a2-bc3a-e7077ad3a96d] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:58:34.177396 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-deb422b5-12fe-403a-a1e9-cc9d186e1706 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:58:34.177853 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-deb422b5-12fe-403a-a1e9-cc9d186e1706 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:58:34.178656 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-deb422b5-12fe-403a-a1e9-cc9d186e1706 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:58:34.179283 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-deb422b5-12fe-403a-a1e9-cc9d186e1706 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:58:34.206253 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-deb422b5-12fe-403a-a1e9-cc9d186e1706 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] [instance: 1b31d7bf-888c-45a2-bc3a-e7077ad3a96d] Going to try to terminate instance {{(pid=123546) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 05 02:58:34.314404 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-deb422b5-12fe-403a-a1e9-cc9d186e1706 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] 10.222.0.26 "DELETE /compute/v2.1/servers/1b31d7bf-888c-45a2-bc3a-e7077ad3a96d" status: 204 len: 0 microversion: 2.20 time: 0.146684 Mar 05 02:58:34.316462 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 358/728] 10.222.0.26 () {60 vars in 1279 bytes} [Sat Mar 5 02:58:34 2022] DELETE /compute/v2.1/servers/1b31d7bf-888c-45a2-bc3a-e7077ad3a96d => generated 0 bytes in 150 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Mar 05 02:58:34.325613 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-9def5223-f12f-4365-b5bd-38d3006f017c tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:58:34.326382 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-9def5223-f12f-4365-b5bd-38d3006f017c tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] [instance: 1b31d7bf-888c-45a2-bc3a-e7077ad3a96d] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:58:34.332641 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-9def5223-f12f-4365-b5bd-38d3006f017c tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:58:34.333344 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-9def5223-f12f-4365-b5bd-38d3006f017c tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:58:34.334381 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-9def5223-f12f-4365-b5bd-38d3006f017c tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:58:34.335061 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-9def5223-f12f-4365-b5bd-38d3006f017c tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:58:34.528021 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-9def5223-f12f-4365-b5bd-38d3006f017c tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:58:34.536401 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-9def5223-f12f-4365-b5bd-38d3006f017c tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:58:34.537882 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-9def5223-f12f-4365-b5bd-38d3006f017c tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:58:34.539231 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-9def5223-f12f-4365-b5bd-38d3006f017c tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] 10.222.0.26 "GET /compute/v2.1/servers/1b31d7bf-888c-45a2-bc3a-e7077ad3a96d" status: 200 len: 1721 microversion: 2.20 time: 0.218600 Mar 05 02:58:34.539820 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 371/729] 10.222.0.26 () {60 vars in 1276 bytes} [Sat Mar 5 02:58:34 2022] GET /compute/v2.1/servers/1b31d7bf-888c-45a2-bc3a-e7077ad3a96d => generated 1721 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 05 02:58:35.556833 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-378a22f8-2f90-4934-b2dd-16a97368cdee tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:58:35.557572 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-378a22f8-2f90-4934-b2dd-16a97368cdee tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] [instance: 1b31d7bf-888c-45a2-bc3a-e7077ad3a96d] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:58:35.565038 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-378a22f8-2f90-4934-b2dd-16a97368cdee tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:58:35.565566 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-378a22f8-2f90-4934-b2dd-16a97368cdee tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:58:35.566441 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-378a22f8-2f90-4934-b2dd-16a97368cdee tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:58:35.567003 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-378a22f8-2f90-4934-b2dd-16a97368cdee tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:58:35.588695 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-f74f1ac6-7eff-446c-ad39-893b25fee325 tempest-VolumesSnapshotsTestJSON-2047988686 tempest-VolumesSnapshotsTestJSON-2047988686-project] Action: 'create', calling method: .version_select at 0x7f3f61cdeee0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1495907343"}} {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 02:58:35.704159 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-378a22f8-2f90-4934-b2dd-16a97368cdee tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:58:35.712017 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-378a22f8-2f90-4934-b2dd-16a97368cdee tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:58:35.713606 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-378a22f8-2f90-4934-b2dd-16a97368cdee tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:58:35.714818 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-378a22f8-2f90-4934-b2dd-16a97368cdee tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] 10.222.0.26 "GET /compute/v2.1/servers/1b31d7bf-888c-45a2-bc3a-e7077ad3a96d" status: 200 len: 1721 microversion: 2.20 time: 0.162208 Mar 05 02:58:35.715385 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 372/730] 10.222.0.26 () {60 vars in 1276 bytes} [Sat Mar 5 02:58:35 2022] GET /compute/v2.1/servers/1b31d7bf-888c-45a2-bc3a-e7077ad3a96d => generated 1721 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 05 02:58:35.878676 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-f74f1ac6-7eff-446c-ad39-893b25fee325 tempest-VolumesSnapshotsTestJSON-2047988686 tempest-VolumesSnapshotsTestJSON-2047988686-project] 10.222.0.26 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.399499 Mar 05 02:58:35.879293 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 359/731] 10.222.0.26 () {60 vars in 1154 bytes} [Sat Mar 5 02:58:35 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 401 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Mar 05 02:58:35.890648 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-f429f945-a8c2-4d0a-809a-32f30a9f89a4 tempest-VolumesSnapshotsTestJSON-2047988686 tempest-VolumesSnapshotsTestJSON-2047988686-project] Calling method '.version_select at 0x7f3f61d413a0>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:58:35.940323 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-f429f945-a8c2-4d0a-809a-32f30a9f89a4 tempest-VolumesSnapshotsTestJSON-2047988686 tempest-VolumesSnapshotsTestJSON-2047988686-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/53beca78-f9f7-49a7-90b4-a0613f3a0ae5" status: 200 len: 345 microversion: 2.1 time: 0.053345 Mar 05 02:58:35.941160 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 373/732] 10.222.0.26 () {58 vars in 1244 bytes} [Sat Mar 5 02:58:35 2022] GET /compute/v2.1/os-volumes/53beca78-f9f7-49a7-90b4-a0613f3a0ae5 => generated 345 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 02:58:36.640548 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [req-32a91fcb-02f4-4dcb-a276-e0ad698e9d1e req-9dfd5175-8119-462a-b9d4-db6b5c6f560f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b31d7bf-888c-45a2-bc3a-e7077ad3a96d", "name": "network-vif-deleted", "tag": "72f8e9b7-28cd-4b80-be32-d7f04625063d"}]} {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 02:58:36.651012 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [req-32a91fcb-02f4-4dcb-a276-e0ad698e9d1e req-9dfd5175-8119-462a-b9d4-db6b5c6f560f service nova] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:58:36.651456 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [req-32a91fcb-02f4-4dcb-a276-e0ad698e9d1e req-9dfd5175-8119-462a-b9d4-db6b5c6f560f service nova] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:58:36.664353 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.compute.server_external_events [req-32a91fcb-02f4-4dcb-a276-e0ad698e9d1e req-9dfd5175-8119-462a-b9d4-db6b5c6f560f service nova] Creating event network-vif-deleted:72f8e9b7-28cd-4b80-be32-d7f04625063d for instance 1b31d7bf-888c-45a2-bc3a-e7077ad3a96d on hv-cinder-82725 Mar 05 02:58:36.669160 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [req-32a91fcb-02f4-4dcb-a276-e0ad698e9d1e req-9dfd5175-8119-462a-b9d4-db6b5c6f560f service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032809 Mar 05 02:58:36.669800 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 360/733] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Mar 5 02:58:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 02:58:36.737737 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-fd33111a-dab6-4bc0-af57-8451d9a05ae5 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:58:36.739071 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-fd33111a-dab6-4bc0-af57-8451d9a05ae5 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] [instance: 1b31d7bf-888c-45a2-bc3a-e7077ad3a96d] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:58:36.745459 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-fd33111a-dab6-4bc0-af57-8451d9a05ae5 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:58:36.746232 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-fd33111a-dab6-4bc0-af57-8451d9a05ae5 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:58:36.747319 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-fd33111a-dab6-4bc0-af57-8451d9a05ae5 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:58:36.747761 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-fd33111a-dab6-4bc0-af57-8451d9a05ae5 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:58:36.798596 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-fd33111a-dab6-4bc0-af57-8451d9a05ae5 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:58:36.799463 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-fd33111a-dab6-4bc0-af57-8451d9a05ae5 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:58:36.800080 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.objects.instance [None req-fd33111a-dab6-4bc0-af57-8451d9a05ae5 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lazy-loading 'fault' on Instance uuid 1b31d7bf-888c-45a2-bc3a-e7077ad3a96d {{(pid=123545) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 05 02:58:36.849145 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-fd33111a-dab6-4bc0-af57-8451d9a05ae5 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:58:36.858993 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-fd33111a-dab6-4bc0-af57-8451d9a05ae5 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:58:36.860583 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-fd33111a-dab6-4bc0-af57-8451d9a05ae5 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c599ce47ad9147d29c93e3984b9652a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533ddcf7f3bc4068a6f2856eb915ecb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:58:36.861767 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-fd33111a-dab6-4bc0-af57-8451d9a05ae5 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] 10.222.0.26 "GET /compute/v2.1/servers/1b31d7bf-888c-45a2-bc3a-e7077ad3a96d" status: 200 len: 1370 microversion: 2.20 time: 0.129383 Mar 05 02:58:36.862382 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 374/734] 10.222.0.26 () {60 vars in 1276 bytes} [Sat Mar 5 02:58:36 2022] GET /compute/v2.1/servers/1b31d7bf-888c-45a2-bc3a-e7077ad3a96d => generated 1370 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 05 02:58:36.953184 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-c4f5c845-a046-414d-9db6-247ad9688189 tempest-VolumesSnapshotsTestJSON-2047988686 tempest-VolumesSnapshotsTestJSON-2047988686-project] Calling method '.version_select at 0x7f3f61d67670>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:58:37.002936 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-c4f5c845-a046-414d-9db6-247ad9688189 tempest-VolumesSnapshotsTestJSON-2047988686 tempest-VolumesSnapshotsTestJSON-2047988686-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/53beca78-f9f7-49a7-90b4-a0613f3a0ae5" status: 200 len: 346 microversion: 2.1 time: 0.053960 Mar 05 02:58:37.003512 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 361/735] 10.222.0.26 () {58 vars in 1244 bytes} [Sat Mar 5 02:58:36 2022] GET /compute/v2.1/os-volumes/53beca78-f9f7-49a7-90b4-a0613f3a0ae5 => generated 346 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 02:58:37.014294 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-c36290f4-4f24-4999-8c64-25727b127d78 tempest-VolumesSnapshotsTestJSON-2047988686 tempest-VolumesSnapshotsTestJSON-2047988686-project] Action: 'create', calling method: .version_select at 0x7f3f61d41e50>, body: {"snapshot": {"volume_id": "53beca78-f9f7-49a7-90b4-a0613f3a0ae5", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1381438947"}} {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 02:58:37.179776 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-c36290f4-4f24-4999-8c64-25727b127d78 tempest-VolumesSnapshotsTestJSON-2047988686 tempest-VolumesSnapshotsTestJSON-2047988686-project] 10.222.0.26 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.169220 Mar 05 02:58:37.180469 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 375/736] 10.222.0.26 () {60 vars in 1161 bytes} [Sat Mar 5 02:58:37 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 02:58:37.191846 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-9a51e826-8b0a-4d66-b47b-a3babc3b3daa tempest-VolumesSnapshotsTestJSON-2047988686 tempest-VolumesSnapshotsTestJSON-2047988686-project] Calling method '.version_select at 0x7f3f61c58790>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:58:37.223114 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-9a51e826-8b0a-4d66-b47b-a3babc3b3daa tempest-VolumesSnapshotsTestJSON-2047988686 tempest-VolumesSnapshotsTestJSON-2047988686-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots/03b5137a-dd1e-4ad6-9376-60c7a6273b8a" status: 200 len: 287 microversion: 2.1 time: 0.035973 Mar 05 02:58:37.223695 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 362/737] 10.222.0.26 () {58 vars in 1250 bytes} [Sat Mar 5 02:58:37 2022] GET /compute/v2.1/os-snapshots/03b5137a-dd1e-4ad6-9376-60c7a6273b8a => generated 287 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 02:58:37.233745 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-a8b8ff38-5f10-4202-bc39-5365d9c0c67c tempest-VolumesSnapshotsTestJSON-2047988686 tempest-VolumesSnapshotsTestJSON-2047988686-project] Calling method '.version_select at 0x7f3f61ccfaf0>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:58:37.263507 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-a8b8ff38-5f10-4202-bc39-5365d9c0c67c tempest-VolumesSnapshotsTestJSON-2047988686 tempest-VolumesSnapshotsTestJSON-2047988686-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.033493 Mar 05 02:58:37.264076 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 376/738] 10.222.0.26 () {58 vars in 1139 bytes} [Sat Mar 5 02:58:37 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 02:58:37.274840 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-3098255b-8bbb-4152-be23-2217690c7dbf tempest-VolumesSnapshotsTestJSON-2047988686 tempest-VolumesSnapshotsTestJSON-2047988686-project] Calling method '.version_select at 0x7f3f61d7a790>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:58:37.303795 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-3098255b-8bbb-4152-be23-2217690c7dbf tempest-VolumesSnapshotsTestJSON-2047988686 tempest-VolumesSnapshotsTestJSON-2047988686-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots/03b5137a-dd1e-4ad6-9376-60c7a6273b8a" status: 200 len: 287 microversion: 2.1 time: 0.032774 Mar 05 02:58:37.304364 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 363/739] 10.222.0.26 () {58 vars in 1250 bytes} [Sat Mar 5 02:58:37 2022] GET /compute/v2.1/os-snapshots/03b5137a-dd1e-4ad6-9376-60c7a6273b8a => generated 287 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 02:58:37.881511 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-ae1e3c37-fa2d-4216-b358-e66d752b25e2 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:58:37.882137 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-ae1e3c37-fa2d-4216-b358-e66d752b25e2 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] [instance: 1b31d7bf-888c-45a2-bc3a-e7077ad3a96d] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:58:37.889688 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-ae1e3c37-fa2d-4216-b358-e66d752b25e2 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:58:37.890174 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-ae1e3c37-fa2d-4216-b358-e66d752b25e2 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:58:37.890936 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-ae1e3c37-fa2d-4216-b358-e66d752b25e2 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:58:37.891366 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-ae1e3c37-fa2d-4216-b358-e66d752b25e2 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:58:37.904607 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.wsgi [None req-ae1e3c37-fa2d-4216-b358-e66d752b25e2 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] HTTP exception thrown: Instance 1b31d7bf-888c-45a2-bc3a-e7077ad3a96d could not be found. Mar 05 02:58:37.905182 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-ae1e3c37-fa2d-4216-b358-e66d752b25e2 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Returning 404 to user: Instance 1b31d7bf-888c-45a2-bc3a-e7077ad3a96d could not be found. {{(pid=123545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 02:58:37.906004 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-ae1e3c37-fa2d-4216-b358-e66d752b25e2 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] 10.222.0.26 "GET /compute/v2.1/servers/1b31d7bf-888c-45a2-bc3a-e7077ad3a96d" status: 404 len: 111 microversion: 2.20 time: 0.029047 Mar 05 02:58:37.906523 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 377/740] 10.222.0.26 () {60 vars in 1276 bytes} [Sat Mar 5 02:58:37 2022] GET /compute/v2.1/servers/1b31d7bf-888c-45a2-bc3a-e7077ad3a96d => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Mar 05 02:58:37.915455 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-7620c7a9-5363-47a1-bf2c-a8e1b9b8a50c tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Calling method '.version_select at 0x7f3f61c585e0>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:58:37.933521 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-7620c7a9-5363-47a1-bf2c-a8e1b9b8a50c tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-547835302" status: 204 len: 0 microversion: 2.20 time: 0.022341 Mar 05 02:58:37.934171 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 364/741] 10.222.0.26 () {60 vars in 1258 bytes} [Sat Mar 5 02:58:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-547835302 => generated 0 bytes in 24 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Mar 05 02:58:38.315478 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-70d5919b-7fee-4f1b-ae90-f16161d60074 tempest-VolumesSnapshotsTestJSON-2047988686 tempest-VolumesSnapshotsTestJSON-2047988686-project] Calling method '.version_select at 0x7f3f61d41160>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:58:38.344009 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-70d5919b-7fee-4f1b-ae90-f16161d60074 tempest-VolumesSnapshotsTestJSON-2047988686 tempest-VolumesSnapshotsTestJSON-2047988686-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots/03b5137a-dd1e-4ad6-9376-60c7a6273b8a" status: 200 len: 287 microversion: 2.1 time: 0.032245 Mar 05 02:58:38.344659 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 378/742] 10.222.0.26 () {58 vars in 1250 bytes} [Sat Mar 5 02:58:38 2022] GET /compute/v2.1/os-snapshots/03b5137a-dd1e-4ad6-9376-60c7a6273b8a => generated 287 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 02:58:39.356213 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-4f4d55d9-67bc-4535-bd7c-c67999485dfa tempest-VolumesSnapshotsTestJSON-2047988686 tempest-VolumesSnapshotsTestJSON-2047988686-project] Calling method '.version_select at 0x7f3f61c979d0>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:58:39.388759 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-4f4d55d9-67bc-4535-bd7c-c67999485dfa tempest-VolumesSnapshotsTestJSON-2047988686 tempest-VolumesSnapshotsTestJSON-2047988686-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots/03b5137a-dd1e-4ad6-9376-60c7a6273b8a" status: 200 len: 287 microversion: 2.1 time: 0.037113 Mar 05 02:58:39.389326 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 365/743] 10.222.0.26 () {58 vars in 1250 bytes} [Sat Mar 5 02:58:39 2022] GET /compute/v2.1/os-snapshots/03b5137a-dd1e-4ad6-9376-60c7a6273b8a => generated 287 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 02:58:40.401629 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-e721bd17-ddb4-4bfe-9f99-c71e1458d4f7 tempest-VolumesSnapshotsTestJSON-2047988686 tempest-VolumesSnapshotsTestJSON-2047988686-project] Calling method '.version_select at 0x7f3f61d4bf70>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:58:40.429714 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-e721bd17-ddb4-4bfe-9f99-c71e1458d4f7 tempest-VolumesSnapshotsTestJSON-2047988686 tempest-VolumesSnapshotsTestJSON-2047988686-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots/03b5137a-dd1e-4ad6-9376-60c7a6273b8a" status: 200 len: 288 microversion: 2.1 time: 0.032357 Mar 05 02:58:40.430297 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 379/744] 10.222.0.26 () {58 vars in 1250 bytes} [Sat Mar 5 02:58:40 2022] GET /compute/v2.1/os-snapshots/03b5137a-dd1e-4ad6-9376-60c7a6273b8a => generated 288 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 02:58:40.441412 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-34268323-f102-4b6e-9de1-97d3b0a253f9 tempest-VolumesSnapshotsTestJSON-2047988686 tempest-VolumesSnapshotsTestJSON-2047988686-project] Calling method '.version_select at 0x7f3f61c66280>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:58:40.496202 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-34268323-f102-4b6e-9de1-97d3b0a253f9 tempest-VolumesSnapshotsTestJSON-2047988686 tempest-VolumesSnapshotsTestJSON-2047988686-project] 10.222.0.26 "DELETE /compute/v2.1/os-snapshots/03b5137a-dd1e-4ad6-9376-60c7a6273b8a" status: 202 len: 0 microversion: 2.1 time: 0.059631 Mar 05 02:58:40.496895 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 366/745] 10.222.0.26 () {58 vars in 1253 bytes} [Sat Mar 5 02:58:40 2022] DELETE /compute/v2.1/os-snapshots/03b5137a-dd1e-4ad6-9376-60c7a6273b8a => generated 0 bytes in 61 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 05 02:58:40.505816 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-8e50d23e-5d88-4a32-be60-5334c810f146 tempest-VolumesSnapshotsTestJSON-2047988686 tempest-VolumesSnapshotsTestJSON-2047988686-project] Calling method '.version_select at 0x7f3f61d4b700>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:58:40.534703 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-8e50d23e-5d88-4a32-be60-5334c810f146 tempest-VolumesSnapshotsTestJSON-2047988686 tempest-VolumesSnapshotsTestJSON-2047988686-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots/03b5137a-dd1e-4ad6-9376-60c7a6273b8a" status: 200 len: 287 microversion: 2.1 time: 0.033187 Mar 05 02:58:40.535258 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 380/746] 10.222.0.26 () {58 vars in 1250 bytes} [Sat Mar 5 02:58:40 2022] GET /compute/v2.1/os-snapshots/03b5137a-dd1e-4ad6-9376-60c7a6273b8a => generated 287 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 02:58:40.713172 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-eb2a759a-add5-4430-a2a9-5d75c849db7a tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:58:40.713790 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-eb2a759a-add5-4430-a2a9-5d75c849db7a tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] [instance: 1b31d7bf-888c-45a2-bc3a-e7077ad3a96d] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:58:40.720500 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-eb2a759a-add5-4430-a2a9-5d75c849db7a tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:58:40.720951 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-eb2a759a-add5-4430-a2a9-5d75c849db7a tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:58:40.721719 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-eb2a759a-add5-4430-a2a9-5d75c849db7a tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:58:40.722209 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-eb2a759a-add5-4430-a2a9-5d75c849db7a tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:58:40.736420 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.wsgi [None req-eb2a759a-add5-4430-a2a9-5d75c849db7a tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] HTTP exception thrown: Instance 1b31d7bf-888c-45a2-bc3a-e7077ad3a96d could not be found. Mar 05 02:58:40.737040 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-eb2a759a-add5-4430-a2a9-5d75c849db7a tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Returning 404 to user: Instance 1b31d7bf-888c-45a2-bc3a-e7077ad3a96d could not be found. {{(pid=123546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 02:58:40.737864 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-eb2a759a-add5-4430-a2a9-5d75c849db7a tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] 10.222.0.26 "DELETE /compute/v2.1/servers/1b31d7bf-888c-45a2-bc3a-e7077ad3a96d" status: 404 len: 111 microversion: 2.20 time: 0.028677 Mar 05 02:58:40.738474 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 367/747] 10.222.0.26 () {60 vars in 1279 bytes} [Sat Mar 5 02:58:40 2022] DELETE /compute/v2.1/servers/1b31d7bf-888c-45a2-bc3a-e7077ad3a96d => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Mar 05 02:58:40.746515 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-1054bce6-8085-414f-aec2-5ba0e3e912dc tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:58:40.747118 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-1054bce6-8085-414f-aec2-5ba0e3e912dc tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] [instance: 1b31d7bf-888c-45a2-bc3a-e7077ad3a96d] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:58:40.752915 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-1054bce6-8085-414f-aec2-5ba0e3e912dc tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:58:40.753362 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-1054bce6-8085-414f-aec2-5ba0e3e912dc tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:58:40.754157 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-1054bce6-8085-414f-aec2-5ba0e3e912dc tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:58:40.754614 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-1054bce6-8085-414f-aec2-5ba0e3e912dc tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:58:40.766963 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.wsgi [None req-1054bce6-8085-414f-aec2-5ba0e3e912dc tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] HTTP exception thrown: Instance 1b31d7bf-888c-45a2-bc3a-e7077ad3a96d could not be found. Mar 05 02:58:40.767640 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-1054bce6-8085-414f-aec2-5ba0e3e912dc tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Returning 404 to user: Instance 1b31d7bf-888c-45a2-bc3a-e7077ad3a96d could not be found. {{(pid=123545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 02:58:40.768437 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-1054bce6-8085-414f-aec2-5ba0e3e912dc tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] 10.222.0.26 "GET /compute/v2.1/servers/1b31d7bf-888c-45a2-bc3a-e7077ad3a96d" status: 404 len: 111 microversion: 2.20 time: 0.025757 Mar 05 02:58:40.768954 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 381/748] 10.222.0.26 () {60 vars in 1276 bytes} [Sat Mar 5 02:58:40 2022] GET /compute/v2.1/servers/1b31d7bf-888c-45a2-bc3a-e7077ad3a96d => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Mar 05 02:58:41.546487 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-32a4270c-ef15-42e3-99c8-121535c2454f tempest-VolumesSnapshotsTestJSON-2047988686 tempest-VolumesSnapshotsTestJSON-2047988686-project] Calling method '.version_select at 0x7f3f61d67310>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:58:41.571243 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.wsgi [None req-32a4270c-ef15-42e3-99c8-121535c2454f tempest-VolumesSnapshotsTestJSON-2047988686 tempest-VolumesSnapshotsTestJSON-2047988686-project] HTTP exception thrown: Snapshot 03b5137a-dd1e-4ad6-9376-60c7a6273b8a could not be found. Mar 05 02:58:41.571831 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-32a4270c-ef15-42e3-99c8-121535c2454f tempest-VolumesSnapshotsTestJSON-2047988686 tempest-VolumesSnapshotsTestJSON-2047988686-project] Returning 404 to user: Snapshot 03b5137a-dd1e-4ad6-9376-60c7a6273b8a could not be found. {{(pid=123546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 02:58:41.572718 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-32a4270c-ef15-42e3-99c8-121535c2454f tempest-VolumesSnapshotsTestJSON-2047988686 tempest-VolumesSnapshotsTestJSON-2047988686-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots/03b5137a-dd1e-4ad6-9376-60c7a6273b8a" status: 404 len: 111 microversion: 2.1 time: 0.030320 Mar 05 02:58:41.573283 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 368/749] 10.222.0.26 () {58 vars in 1250 bytes} [Sat Mar 5 02:58:41 2022] GET /compute/v2.1/os-snapshots/03b5137a-dd1e-4ad6-9376-60c7a6273b8a => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 05 02:58:41.582074 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-b54c131c-a1c6-40ed-b0f6-edd821f034ef tempest-VolumesSnapshotsTestJSON-2047988686 tempest-VolumesSnapshotsTestJSON-2047988686-project] Calling method '.version_select at 0x7f3f61d415e0>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:58:41.638802 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-b54c131c-a1c6-40ed-b0f6-edd821f034ef tempest-VolumesSnapshotsTestJSON-2047988686 tempest-VolumesSnapshotsTestJSON-2047988686-project] 10.222.0.26 "DELETE /compute/v2.1/os-volumes/53beca78-f9f7-49a7-90b4-a0613f3a0ae5" status: 202 len: 0 microversion: 2.1 time: 0.061244 Mar 05 02:58:41.639524 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 382/750] 10.222.0.26 () {58 vars in 1247 bytes} [Sat Mar 5 02:58:41 2022] DELETE /compute/v2.1/os-volumes/53beca78-f9f7-49a7-90b4-a0613f3a0ae5 => generated 0 bytes in 63 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 05 02:58:41.648407 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-4c318955-367f-4317-8dc0-8eb8625c6b64 tempest-VolumesSnapshotsTestJSON-2047988686 tempest-VolumesSnapshotsTestJSON-2047988686-project] Calling method '.version_select at 0x7f3f61c97160>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:58:41.696342 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-4c318955-367f-4317-8dc0-8eb8625c6b64 tempest-VolumesSnapshotsTestJSON-2047988686 tempest-VolumesSnapshotsTestJSON-2047988686-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/53beca78-f9f7-49a7-90b4-a0613f3a0ae5" status: 200 len: 345 microversion: 2.1 time: 0.051645 Mar 05 02:58:41.696913 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 369/751] 10.222.0.26 () {58 vars in 1244 bytes} [Sat Mar 5 02:58:41 2022] GET /compute/v2.1/os-volumes/53beca78-f9f7-49a7-90b4-a0613f3a0ae5 => generated 345 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 02:58:41.901211 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-c4ca5cfb-1a9b-46a8-a08b-0d7bf430c9de tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:58:41.901762 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-c4ca5cfb-1a9b-46a8-a08b-0d7bf430c9de tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] [instance: e28e570d-3d50-4fe8-bb4a-fe0e95c20fb7] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:58:41.908445 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-c4ca5cfb-1a9b-46a8-a08b-0d7bf430c9de tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:58:41.908893 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-c4ca5cfb-1a9b-46a8-a08b-0d7bf430c9de tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:58:41.909663 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-c4ca5cfb-1a9b-46a8-a08b-0d7bf430c9de tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:58:41.910133 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-c4ca5cfb-1a9b-46a8-a08b-0d7bf430c9de tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:58:41.923042 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.wsgi [None req-c4ca5cfb-1a9b-46a8-a08b-0d7bf430c9de tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] HTTP exception thrown: Instance e28e570d-3d50-4fe8-bb4a-fe0e95c20fb7 could not be found. Mar 05 02:58:41.923621 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-c4ca5cfb-1a9b-46a8-a08b-0d7bf430c9de tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Returning 404 to user: Instance e28e570d-3d50-4fe8-bb4a-fe0e95c20fb7 could not be found. {{(pid=123545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 02:58:41.924424 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-c4ca5cfb-1a9b-46a8-a08b-0d7bf430c9de tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] 10.222.0.26 "DELETE /compute/v2.1/servers/e28e570d-3d50-4fe8-bb4a-fe0e95c20fb7" status: 404 len: 111 microversion: 2.20 time: 0.027055 Mar 05 02:58:41.924947 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 383/752] 10.222.0.26 () {60 vars in 1279 bytes} [Sat Mar 5 02:58:41 2022] DELETE /compute/v2.1/servers/e28e570d-3d50-4fe8-bb4a-fe0e95c20fb7 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Mar 05 02:58:41.933413 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-c1879d6e-51e5-4903-88bb-a6a36f45c395 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:58:41.934243 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-c1879d6e-51e5-4903-88bb-a6a36f45c395 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] [instance: e28e570d-3d50-4fe8-bb4a-fe0e95c20fb7] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:58:41.940171 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-c1879d6e-51e5-4903-88bb-a6a36f45c395 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:58:41.940616 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-c1879d6e-51e5-4903-88bb-a6a36f45c395 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:58:41.941378 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-c1879d6e-51e5-4903-88bb-a6a36f45c395 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:58:41.941812 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-c1879d6e-51e5-4903-88bb-a6a36f45c395 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:58:41.955032 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.wsgi [None req-c1879d6e-51e5-4903-88bb-a6a36f45c395 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] HTTP exception thrown: Instance e28e570d-3d50-4fe8-bb4a-fe0e95c20fb7 could not be found. Mar 05 02:58:41.955739 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-c1879d6e-51e5-4903-88bb-a6a36f45c395 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] Returning 404 to user: Instance e28e570d-3d50-4fe8-bb4a-fe0e95c20fb7 could not be found. {{(pid=123546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 02:58:41.956566 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-c1879d6e-51e5-4903-88bb-a6a36f45c395 tempest-AttachVolumeShelveTestJSON-179519889 tempest-AttachVolumeShelveTestJSON-179519889-project] 10.222.0.26 "GET /compute/v2.1/servers/e28e570d-3d50-4fe8-bb4a-fe0e95c20fb7" status: 404 len: 111 microversion: 2.20 time: 0.027550 Mar 05 02:58:41.957091 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 370/753] 10.222.0.26 () {60 vars in 1276 bytes} [Sat Mar 5 02:58:41 2022] GET /compute/v2.1/servers/e28e570d-3d50-4fe8-bb4a-fe0e95c20fb7 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Mar 05 02:58:42.708644 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-1ca3c6dd-a121-4393-bbc2-92df383ef308 tempest-VolumesSnapshotsTestJSON-2047988686 tempest-VolumesSnapshotsTestJSON-2047988686-project] Calling method '.version_select at 0x7f3f61d41550>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:58:42.737380 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.wsgi [None req-1ca3c6dd-a121-4393-bbc2-92df383ef308 tempest-VolumesSnapshotsTestJSON-2047988686 tempest-VolumesSnapshotsTestJSON-2047988686-project] HTTP exception thrown: Volume 53beca78-f9f7-49a7-90b4-a0613f3a0ae5 could not be found. Mar 05 02:58:42.738076 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-1ca3c6dd-a121-4393-bbc2-92df383ef308 tempest-VolumesSnapshotsTestJSON-2047988686 tempest-VolumesSnapshotsTestJSON-2047988686-project] Returning 404 to user: Volume 53beca78-f9f7-49a7-90b4-a0613f3a0ae5 could not be found. {{(pid=123545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 02:58:42.738942 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-1ca3c6dd-a121-4393-bbc2-92df383ef308 tempest-VolumesSnapshotsTestJSON-2047988686 tempest-VolumesSnapshotsTestJSON-2047988686-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/53beca78-f9f7-49a7-90b4-a0613f3a0ae5" status: 404 len: 109 microversion: 2.1 time: 0.034225 Mar 05 02:58:42.739485 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 384/754] 10.222.0.26 () {58 vars in 1244 bytes} [Sat Mar 5 02:58:42 2022] GET /compute/v2.1/os-volumes/53beca78-f9f7-49a7-90b4-a0613f3a0ae5 => generated 109 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 05 02:58:42.754024 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-998ddeab-d12f-49e5-9d33-3b2c88d92225 tempest-VolumesSnapshotsTestJSON-2047988686 tempest-VolumesSnapshotsTestJSON-2047988686-project] Calling method '.version_select at 0x7f3f61c5cee0>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:58:42.780286 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.wsgi [None req-998ddeab-d12f-49e5-9d33-3b2c88d92225 tempest-VolumesSnapshotsTestJSON-2047988686 tempest-VolumesSnapshotsTestJSON-2047988686-project] HTTP exception thrown: Volume 53beca78-f9f7-49a7-90b4-a0613f3a0ae5 could not be found. Mar 05 02:58:42.780904 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-998ddeab-d12f-49e5-9d33-3b2c88d92225 tempest-VolumesSnapshotsTestJSON-2047988686 tempest-VolumesSnapshotsTestJSON-2047988686-project] Returning 404 to user: Volume 53beca78-f9f7-49a7-90b4-a0613f3a0ae5 could not be found. {{(pid=123546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 02:58:42.781720 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-998ddeab-d12f-49e5-9d33-3b2c88d92225 tempest-VolumesSnapshotsTestJSON-2047988686 tempest-VolumesSnapshotsTestJSON-2047988686-project] 10.222.0.26 "DELETE /compute/v2.1/os-volumes/53beca78-f9f7-49a7-90b4-a0613f3a0ae5" status: 404 len: 109 microversion: 2.1 time: 0.032474 Mar 05 02:58:42.782871 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 371/755] 10.222.0.26 () {58 vars in 1247 bytes} [Sat Mar 5 02:58:42 2022] DELETE /compute/v2.1/os-volumes/53beca78-f9f7-49a7-90b4-a0613f3a0ae5 => generated 109 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 05 02:58:42.791542 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-2a23c1b2-eb07-4901-b3be-e7f473ae3fbd tempest-VolumesSnapshotsTestJSON-2047988686 tempest-VolumesSnapshotsTestJSON-2047988686-project] Calling method '.version_select at 0x7f3f61d41310>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:58:42.818654 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.wsgi [None req-2a23c1b2-eb07-4901-b3be-e7f473ae3fbd tempest-VolumesSnapshotsTestJSON-2047988686 tempest-VolumesSnapshotsTestJSON-2047988686-project] HTTP exception thrown: Volume 53beca78-f9f7-49a7-90b4-a0613f3a0ae5 could not be found. Mar 05 02:58:42.819245 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-2a23c1b2-eb07-4901-b3be-e7f473ae3fbd tempest-VolumesSnapshotsTestJSON-2047988686 tempest-VolumesSnapshotsTestJSON-2047988686-project] Returning 404 to user: Volume 53beca78-f9f7-49a7-90b4-a0613f3a0ae5 could not be found. {{(pid=123545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 02:58:42.820070 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-2a23c1b2-eb07-4901-b3be-e7f473ae3fbd tempest-VolumesSnapshotsTestJSON-2047988686 tempest-VolumesSnapshotsTestJSON-2047988686-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/53beca78-f9f7-49a7-90b4-a0613f3a0ae5" status: 404 len: 109 microversion: 2.1 time: 0.033158 Mar 05 02:58:42.820616 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 385/756] 10.222.0.26 () {58 vars in 1244 bytes} [Sat Mar 5 02:58:42 2022] GET /compute/v2.1/os-volumes/53beca78-f9f7-49a7-90b4-a0613f3a0ae5 => generated 109 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 05 02:58:51.806998 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-6c1d5eb9-841d-4100-b3b6-df64118d798f tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:58:51.807553 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-6c1d5eb9-841d-4100-b3b6-df64118d798f tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] [instance: 939b0cc0-f089-45e5-b1d4-c1117de03050] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:58:51.813814 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-6c1d5eb9-841d-4100-b3b6-df64118d798f tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:58:51.814357 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-6c1d5eb9-841d-4100-b3b6-df64118d798f tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:58:51.815165 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-6c1d5eb9-841d-4100-b3b6-df64118d798f tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:58:51.815607 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-6c1d5eb9-841d-4100-b3b6-df64118d798f tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:58:51.840329 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-6c1d5eb9-841d-4100-b3b6-df64118d798f tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] 10.222.0.26 "GET /compute/v2.1/servers/939b0cc0-f089-45e5-b1d4-c1117de03050/ips" status: 200 len: 150 microversion: 2.1 time: 0.040593 Mar 05 02:58:51.840895 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 372/757] 10.222.0.26 () {58 vars in 1247 bytes} [Sat Mar 5 02:58:51 2022] GET /compute/v2.1/servers/939b0cc0-f089-45e5-b1d4-c1117de03050/ips => generated 150 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 02:58:56.288760 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-84fa4629-bb42-4c77-920c-ed318cb7762b tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7a51e9d8-6756-4635-b826-c514e0caac16"}} {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 02:58:56.289838 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-84fa4629-bb42-4c77-920c-ed318cb7762b tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] [instance: 939b0cc0-f089-45e5-b1d4-c1117de03050] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:58:56.296682 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-84fa4629-bb42-4c77-920c-ed318cb7762b tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:58:56.297189 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-84fa4629-bb42-4c77-920c-ed318cb7762b tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:58:56.298613 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-84fa4629-bb42-4c77-920c-ed318cb7762b tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:58:56.299178 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-84fa4629-bb42-4c77-920c-ed318cb7762b tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:58:56.533417 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-84fa4629-bb42-4c77-920c-ed318cb7762b tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] 10.222.0.26 "POST /compute/v2.1/servers/939b0cc0-f089-45e5-b1d4-c1117de03050/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.249237 Mar 05 02:58:56.534055 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 386/758] 10.222.0.26 () {60 vars in 1322 bytes} [Sat Mar 5 02:58:56 2022] POST /compute/v2.1/servers/939b0cc0-f089-45e5-b1d4-c1117de03050/os-volume_attachments => generated 194 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 02:59:06.136167 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-b728fb39-1b3b-4d6a-825b-db2f89a60c9e tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7a51e9d8-6756-4635-b826-c514e0caac16"}} {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 02:59:06.137306 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-b728fb39-1b3b-4d6a-825b-db2f89a60c9e tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] [instance: 939b0cc0-f089-45e5-b1d4-c1117de03050] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:59:06.144609 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-b728fb39-1b3b-4d6a-825b-db2f89a60c9e tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:59:06.145073 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-b728fb39-1b3b-4d6a-825b-db2f89a60c9e tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:59:06.145853 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-b728fb39-1b3b-4d6a-825b-db2f89a60c9e tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:59:06.146324 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-b728fb39-1b3b-4d6a-825b-db2f89a60c9e tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:59:06.229414 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.wsgi [None req-b728fb39-1b3b-4d6a-825b-db2f89a60c9e tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] HTTP exception thrown: Invalid volume: volume 7a51e9d8-6756-4635-b826-c514e0caac16 is already attached to instances: 939b0cc0-f089-45e5-b1d4-c1117de03050 Mar 05 02:59:06.235657 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-b728fb39-1b3b-4d6a-825b-db2f89a60c9e tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Returning 400 to user: Invalid volume: volume 7a51e9d8-6756-4635-b826-c514e0caac16 is already attached to instances: 939b0cc0-f089-45e5-b1d4-c1117de03050 {{(pid=123546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 02:59:06.235657 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-b728fb39-1b3b-4d6a-825b-db2f89a60c9e tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] 10.222.0.26 "POST /compute/v2.1/servers/939b0cc0-f089-45e5-b1d4-c1117de03050/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.099160 Mar 05 02:59:06.235657 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 373/759] 10.222.0.26 () {60 vars in 1322 bytes} [Sat Mar 5 02:59:06 2022] POST /compute/v2.1/servers/939b0cc0-f089-45e5-b1d4-c1117de03050/os-volume_attachments => generated 174 bytes in 100 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Mar 05 02:59:06.298481 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-c019b1ef-e9f8-412f-9e54-95bab6b5bbee tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:59:06.299047 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-c019b1ef-e9f8-412f-9e54-95bab6b5bbee tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] [instance: 939b0cc0-f089-45e5-b1d4-c1117de03050] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:59:06.305236 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-c019b1ef-e9f8-412f-9e54-95bab6b5bbee tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:59:06.305684 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-c019b1ef-e9f8-412f-9e54-95bab6b5bbee tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:59:06.306518 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-c019b1ef-e9f8-412f-9e54-95bab6b5bbee tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:59:06.306944 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-c019b1ef-e9f8-412f-9e54-95bab6b5bbee tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:59:06.395079 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.objects.instance [None req-c019b1ef-e9f8-412f-9e54-95bab6b5bbee tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lazy-loading 'services' on Instance uuid 939b0cc0-f089-45e5-b1d4-c1117de03050 {{(pid=123545) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 05 02:59:06.463638 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-c019b1ef-e9f8-412f-9e54-95bab6b5bbee tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] 10.222.0.26 "DELETE /compute/v2.1/servers/939b0cc0-f089-45e5-b1d4-c1117de03050/os-volume_attachments/7a51e9d8-6756-4635-b826-c514e0caac16" status: 202 len: 0 microversion: 2.1 time: 0.169860 Mar 05 02:59:06.464325 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 387/760] 10.222.0.26 () {58 vars in 1415 bytes} [Sat Mar 5 02:59:06 2022] DELETE /compute/v2.1/servers/939b0cc0-f089-45e5-b1d4-c1117de03050/os-volume_attachments/7a51e9d8-6756-4635-b826-c514e0caac16 => generated 0 bytes in 172 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 05 02:59:06.472600 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-ba21d06a-4907-4c5b-932f-1251d8976bc7 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:59:06.473735 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-ba21d06a-4907-4c5b-932f-1251d8976bc7 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] [instance: 939b0cc0-f089-45e5-b1d4-c1117de03050] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:59:06.482117 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-ba21d06a-4907-4c5b-932f-1251d8976bc7 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:59:06.483234 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-ba21d06a-4907-4c5b-932f-1251d8976bc7 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:59:06.484206 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-ba21d06a-4907-4c5b-932f-1251d8976bc7 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:59:06.484648 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-ba21d06a-4907-4c5b-932f-1251d8976bc7 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:59:06.517095 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-ba21d06a-4907-4c5b-932f-1251d8976bc7 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] 10.222.0.26 "GET /compute/v2.1/servers/939b0cc0-f089-45e5-b1d4-c1117de03050/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048337 Mar 05 02:59:06.517674 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 374/761] 10.222.0.26 () {58 vars in 1301 bytes} [Sat Mar 5 02:59:06 2022] GET /compute/v2.1/servers/939b0cc0-f089-45e5-b1d4-c1117de03050/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 02:59:07.529869 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-f0301c76-97cd-4946-907e-7da46d95e8d8 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:59:07.531040 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-f0301c76-97cd-4946-907e-7da46d95e8d8 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] [instance: 939b0cc0-f089-45e5-b1d4-c1117de03050] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:59:07.537503 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-f0301c76-97cd-4946-907e-7da46d95e8d8 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:59:07.538130 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-f0301c76-97cd-4946-907e-7da46d95e8d8 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:59:07.539060 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-f0301c76-97cd-4946-907e-7da46d95e8d8 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:59:07.539855 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-f0301c76-97cd-4946-907e-7da46d95e8d8 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:59:07.573495 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-f0301c76-97cd-4946-907e-7da46d95e8d8 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] 10.222.0.26 "GET /compute/v2.1/servers/939b0cc0-f089-45e5-b1d4-c1117de03050/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048373 Mar 05 02:59:07.574276 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 388/762] 10.222.0.26 () {58 vars in 1301 bytes} [Sat Mar 5 02:59:07 2022] GET /compute/v2.1/servers/939b0cc0-f089-45e5-b1d4-c1117de03050/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 05 02:59:07.669101 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-b21ec3ed-7416-4259-82af-9619d9ae69b9 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:59:07.669946 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-b21ec3ed-7416-4259-82af-9619d9ae69b9 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] [instance: 939b0cc0-f089-45e5-b1d4-c1117de03050] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:59:07.679389 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-b21ec3ed-7416-4259-82af-9619d9ae69b9 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:59:07.679389 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-b21ec3ed-7416-4259-82af-9619d9ae69b9 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:59:07.679389 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-b21ec3ed-7416-4259-82af-9619d9ae69b9 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:59:07.679389 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-b21ec3ed-7416-4259-82af-9619d9ae69b9 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:59:07.704747 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-b21ec3ed-7416-4259-82af-9619d9ae69b9 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] [instance: 939b0cc0-f089-45e5-b1d4-c1117de03050] Going to try to terminate instance {{(pid=123546) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 05 02:59:07.781220 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-b21ec3ed-7416-4259-82af-9619d9ae69b9 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] 10.222.0.26 "DELETE /compute/v2.1/servers/939b0cc0-f089-45e5-b1d4-c1117de03050" status: 204 len: 0 microversion: 2.1 time: 0.116372 Mar 05 02:59:07.781830 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 375/763] 10.222.0.26 () {58 vars in 1238 bytes} [Sat Mar 5 02:59:07 2022] DELETE /compute/v2.1/servers/939b0cc0-f089-45e5-b1d4-c1117de03050 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 05 02:59:07.790425 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-30724f6c-f0b0-4fed-bcc3-67e6d460927c tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:59:07.791036 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-30724f6c-f0b0-4fed-bcc3-67e6d460927c tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] [instance: 939b0cc0-f089-45e5-b1d4-c1117de03050] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:59:07.796846 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-30724f6c-f0b0-4fed-bcc3-67e6d460927c tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:59:07.797515 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-30724f6c-f0b0-4fed-bcc3-67e6d460927c tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:59:07.798536 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-30724f6c-f0b0-4fed-bcc3-67e6d460927c tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:59:07.798976 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-30724f6c-f0b0-4fed-bcc3-67e6d460927c tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:59:07.940649 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-30724f6c-f0b0-4fed-bcc3-67e6d460927c tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af8fb7f45f4d4eb180ccaca3d52ed2dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dd2b27540c04b4c8741ce8c9a5e2b47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:59:07.948041 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-30724f6c-f0b0-4fed-bcc3-67e6d460927c tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] 10.222.0.26 "GET /compute/v2.1/servers/939b0cc0-f089-45e5-b1d4-c1117de03050" status: 200 len: 1683 microversion: 2.1 time: 0.161489 Mar 05 02:59:07.948610 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 389/764] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:59:07 2022] GET /compute/v2.1/servers/939b0cc0-f089-45e5-b1d4-c1117de03050 => generated 1683 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 02:59:08.965608 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-acde8445-3432-46db-8f30-dcecf0b85eeb tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:59:08.966330 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-acde8445-3432-46db-8f30-dcecf0b85eeb tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] [instance: 939b0cc0-f089-45e5-b1d4-c1117de03050] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:59:08.973320 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-acde8445-3432-46db-8f30-dcecf0b85eeb tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:59:08.973772 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-acde8445-3432-46db-8f30-dcecf0b85eeb tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:59:08.974588 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-acde8445-3432-46db-8f30-dcecf0b85eeb tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:59:08.975017 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-acde8445-3432-46db-8f30-dcecf0b85eeb tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:59:09.113248 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-acde8445-3432-46db-8f30-dcecf0b85eeb tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af8fb7f45f4d4eb180ccaca3d52ed2dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dd2b27540c04b4c8741ce8c9a5e2b47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:59:09.120903 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-acde8445-3432-46db-8f30-dcecf0b85eeb tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] 10.222.0.26 "GET /compute/v2.1/servers/939b0cc0-f089-45e5-b1d4-c1117de03050" status: 200 len: 1683 microversion: 2.1 time: 0.159495 Mar 05 02:59:09.121469 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 376/765] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:59:08 2022] GET /compute/v2.1/servers/939b0cc0-f089-45e5-b1d4-c1117de03050 => generated 1683 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 02:59:10.138784 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-0f2b7399-96ed-48f2-b3d0-b69161c828ce tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:59:10.139323 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-0f2b7399-96ed-48f2-b3d0-b69161c828ce tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] [instance: 939b0cc0-f089-45e5-b1d4-c1117de03050] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:59:10.146293 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-0f2b7399-96ed-48f2-b3d0-b69161c828ce tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:59:10.146741 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-0f2b7399-96ed-48f2-b3d0-b69161c828ce tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:59:10.147508 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-0f2b7399-96ed-48f2-b3d0-b69161c828ce tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:59:10.147938 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-0f2b7399-96ed-48f2-b3d0-b69161c828ce tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:59:10.327320 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-0f2b7399-96ed-48f2-b3d0-b69161c828ce tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af8fb7f45f4d4eb180ccaca3d52ed2dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dd2b27540c04b4c8741ce8c9a5e2b47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:59:10.334963 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-0f2b7399-96ed-48f2-b3d0-b69161c828ce tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] 10.222.0.26 "GET /compute/v2.1/servers/939b0cc0-f089-45e5-b1d4-c1117de03050" status: 200 len: 1683 microversion: 2.1 time: 0.200025 Mar 05 02:59:10.335541 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 390/766] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:59:10 2022] GET /compute/v2.1/servers/939b0cc0-f089-45e5-b1d4-c1117de03050 => generated 1683 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 02:59:11.352384 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-e51244b6-13e7-4119-a1f3-f7a8025c4103 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:59:11.353946 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-e51244b6-13e7-4119-a1f3-f7a8025c4103 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] [instance: 939b0cc0-f089-45e5-b1d4-c1117de03050] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:59:11.360559 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-e51244b6-13e7-4119-a1f3-f7a8025c4103 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:59:11.360559 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-e51244b6-13e7-4119-a1f3-f7a8025c4103 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:59:11.361603 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-e51244b6-13e7-4119-a1f3-f7a8025c4103 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:59:11.362145 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-e51244b6-13e7-4119-a1f3-f7a8025c4103 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:59:11.478684 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-e51244b6-13e7-4119-a1f3-f7a8025c4103 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af8fb7f45f4d4eb180ccaca3d52ed2dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dd2b27540c04b4c8741ce8c9a5e2b47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:59:11.486977 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-e51244b6-13e7-4119-a1f3-f7a8025c4103 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] 10.222.0.26 "GET /compute/v2.1/servers/939b0cc0-f089-45e5-b1d4-c1117de03050" status: 200 len: 1615 microversion: 2.1 time: 0.138739 Mar 05 02:59:11.487562 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 377/767] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:59:11 2022] GET /compute/v2.1/servers/939b0cc0-f089-45e5-b1d4-c1117de03050 => generated 1615 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 02:59:11.712822 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [req-e24860d2-e318-49c4-a75f-d831cf0729dd req-06e9cc87-451d-4525-a852-e53779210e58 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "939b0cc0-f089-45e5-b1d4-c1117de03050", "name": "network-vif-deleted", "tag": "e4d5a4c8-f77f-4d45-9308-b37892288255"}]} {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 02:59:11.736862 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [req-e24860d2-e318-49c4-a75f-d831cf0729dd req-06e9cc87-451d-4525-a852-e53779210e58 service nova] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:59:11.738923 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [req-e24860d2-e318-49c4-a75f-d831cf0729dd req-06e9cc87-451d-4525-a852-e53779210e58 service nova] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:59:11.760457 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.compute.server_external_events [req-e24860d2-e318-49c4-a75f-d831cf0729dd req-06e9cc87-451d-4525-a852-e53779210e58 service nova] Creating event network-vif-deleted:e4d5a4c8-f77f-4d45-9308-b37892288255 for instance 939b0cc0-f089-45e5-b1d4-c1117de03050 on hv-cinder-82725 Mar 05 02:59:11.766410 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [req-e24860d2-e318-49c4-a75f-d831cf0729dd req-06e9cc87-451d-4525-a852-e53779210e58 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057321 Mar 05 02:59:11.767536 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 391/768] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Mar 5 02:59:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 02:59:12.504697 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-d266673f-cc43-4133-9430-93a34fe94c7f tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:59:12.505844 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-d266673f-cc43-4133-9430-93a34fe94c7f tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] [instance: 939b0cc0-f089-45e5-b1d4-c1117de03050] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:59:12.511921 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-d266673f-cc43-4133-9430-93a34fe94c7f tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:59:12.512726 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-d266673f-cc43-4133-9430-93a34fe94c7f tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:59:12.514093 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-d266673f-cc43-4133-9430-93a34fe94c7f tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:59:12.515001 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-d266673f-cc43-4133-9430-93a34fe94c7f tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:59:12.529714 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.wsgi [None req-d266673f-cc43-4133-9430-93a34fe94c7f tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] HTTP exception thrown: Instance 939b0cc0-f089-45e5-b1d4-c1117de03050 could not be found. Mar 05 02:59:12.530332 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-d266673f-cc43-4133-9430-93a34fe94c7f tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Returning 404 to user: Instance 939b0cc0-f089-45e5-b1d4-c1117de03050 could not be found. {{(pid=123546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 02:59:12.531154 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-d266673f-cc43-4133-9430-93a34fe94c7f tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] 10.222.0.26 "GET /compute/v2.1/servers/939b0cc0-f089-45e5-b1d4-c1117de03050" status: 404 len: 111 microversion: 2.1 time: 0.031192 Mar 05 02:59:12.531725 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 378/769] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:59:12 2022] GET /compute/v2.1/servers/939b0cc0-f089-45e5-b1d4-c1117de03050 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 05 02:59:12.541360 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-e8f654cd-61c9-4e5c-9a3d-f5146bf905c1 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Calling method '.version_select at 0x7f3f61f12700>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:59:12.560035 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-e8f654cd-61c9-4e5c-9a3d-f5146bf905c1 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1676234828" status: 202 len: 0 microversion: 2.1 time: 0.022993 Mar 05 02:59:12.560630 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 392/770] 10.222.0.26 () {58 vars in 1220 bytes} [Sat Mar 5 02:59:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1676234828 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 05 02:59:13.666544 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-f20cdee4-ba65-4488-9250-56ba5b012178 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Action: 'create', calling method: .version_select at 0x7f3f61c589d0>, body: {"keypair": {"name": "tempest-keypair-479854559"}} {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 02:59:13.688056 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.quota [None req-f20cdee4-ba65-4488-9250-56ba5b012178 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Getting quotas for project 3dd2b27540c04b4c8741ce8c9a5e2b47. Resources: {'key_pairs'} {{(pid=123546) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 02:59:13.692297 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.quota [None req-f20cdee4-ba65-4488-9250-56ba5b012178 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Getting quotas for user af8fb7f45f4d4eb180ccaca3d52ed2dc and project 3dd2b27540c04b4c8741ce8c9a5e2b47. Resources: {'key_pairs'} {{(pid=123546) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 02:59:13.926004 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.quota [None req-f20cdee4-ba65-4488-9250-56ba5b012178 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Getting quotas for project 3dd2b27540c04b4c8741ce8c9a5e2b47. Resources: {'key_pairs'} {{(pid=123546) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 02:59:13.929677 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.quota [None req-f20cdee4-ba65-4488-9250-56ba5b012178 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Getting quotas for user af8fb7f45f4d4eb180ccaca3d52ed2dc and project 3dd2b27540c04b4c8741ce8c9a5e2b47. Resources: {'key_pairs'} {{(pid=123546) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 02:59:13.943373 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-f20cdee4-ba65-4488-9250-56ba5b012178 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 2304 microversion: 2.1 time: 0.280952 Mar 05 02:59:13.943985 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 379/771] 10.222.0.26 () {60 vars in 1157 bytes} [Sat Mar 5 02:59:13 2022] POST /compute/v2.1/os-keypairs => generated 2304 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 02:59:15.368356 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-a08a0786-303f-42d3-a3cf-9edd52f9f023 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-177408039", "imageRef": "adbc7df1-116e-4f9f-a28d-a6a3c084cceb", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ea79f853-47ea-48eb-b063-dca7ecd22a4d"}], "security_groups": [{"name": "tempest-securitygroup--197006657"}], "key_name": "tempest-keypair-479854559", "user_data": "}} {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 02:59:15.484488 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.network.neutron [None req-a08a0786-303f-42d3-a3cf-9edd52f9f023 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] validate_networks() for [('ea79f853-47ea-48eb-b063-dca7ecd22a4d', None, None, None, None, None)] {{(pid=123545) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 05 02:59:16.072700 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.virt.hardware [None req-a08a0786-303f-42d3-a3cf-9edd52f9f023 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Flavor limits 0:0:0 {{(pid=123545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 05 02:59:16.073138 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.virt.hardware [None req-a08a0786-303f-42d3-a3cf-9edd52f9f023 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Image limits 0:0:0 {{(pid=123545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 05 02:59:16.073601 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.virt.hardware [None req-a08a0786-303f-42d3-a3cf-9edd52f9f023 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Flavor pref 0:0:0 {{(pid=123545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 05 02:59:16.074036 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.virt.hardware [None req-a08a0786-303f-42d3-a3cf-9edd52f9f023 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Image pref 0:0:0 {{(pid=123545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 05 02:59:16.074450 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.virt.hardware [None req-a08a0786-303f-42d3-a3cf-9edd52f9f023 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 05 02:59:16.085895 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-a08a0786-303f-42d3-a3cf-9edd52f9f023 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:59:16.086379 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-a08a0786-303f-42d3-a3cf-9edd52f9f023 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:59:16.087189 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-a08a0786-303f-42d3-a3cf-9edd52f9f023 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:59:16.087621 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-a08a0786-303f-42d3-a3cf-9edd52f9f023 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:59:16.105613 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.quota [None req-a08a0786-303f-42d3-a3cf-9edd52f9f023 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Getting quotas for project 3dd2b27540c04b4c8741ce8c9a5e2b47. Resources: {'ram', 'cores', 'instances'} {{(pid=123545) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 02:59:16.112950 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.quota [None req-a08a0786-303f-42d3-a3cf-9edd52f9f023 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Getting quotas for user af8fb7f45f4d4eb180ccaca3d52ed2dc and project 3dd2b27540c04b4c8741ce8c9a5e2b47. Resources: {'ram', 'cores', 'instances'} {{(pid=123545) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 02:59:16.125193 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-a08a0786-303f-42d3-a3cf-9edd52f9f023 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Going to run 1 instances... {{(pid=123545) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 05 02:59:16.128921 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-a08a0786-303f-42d3-a3cf-9edd52f9f023 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] [instance: b38da944-08fc-4ef6-bee2-ede7b8829ee8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='adbc7df1-116e-4f9f-a28d-a6a3c084cceb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123545) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 05 02:59:16.180834 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-a08a0786-303f-42d3-a3cf-9edd52f9f023 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.817481 Mar 05 02:59:16.181792 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 393/772] 10.222.0.26 () {60 vars in 1146 bytes} [Sat Mar 5 02:59:15 2022] POST /compute/v2.1/servers => generated 401 bytes in 819 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 05 02:59:16.193059 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-3915e801-cbfc-4f26-b473-ffe048e7c166 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:59:16.193657 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-3915e801-cbfc-4f26-b473-ffe048e7c166 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] [instance: b38da944-08fc-4ef6-bee2-ede7b8829ee8] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:59:16.262409 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-3915e801-cbfc-4f26-b473-ffe048e7c166 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af8fb7f45f4d4eb180ccaca3d52ed2dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dd2b27540c04b4c8741ce8c9a5e2b47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:59:16.269887 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-3915e801-cbfc-4f26-b473-ffe048e7c166 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] 10.222.0.26 "GET /compute/v2.1/servers/b38da944-08fc-4ef6-bee2-ede7b8829ee8" status: 200 len: 1240 microversion: 2.1 time: 0.082395 Mar 05 02:59:16.270677 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 380/773] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:59:16 2022] GET /compute/v2.1/servers/b38da944-08fc-4ef6-bee2-ede7b8829ee8 => generated 1240 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 02:59:17.292223 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-951915c6-c5d0-455d-b885-3c83407c9762 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:59:17.293418 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-951915c6-c5d0-455d-b885-3c83407c9762 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] [instance: b38da944-08fc-4ef6-bee2-ede7b8829ee8] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:59:17.301815 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-951915c6-c5d0-455d-b885-3c83407c9762 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:59:17.302605 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-951915c6-c5d0-455d-b885-3c83407c9762 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:59:17.303763 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-951915c6-c5d0-455d-b885-3c83407c9762 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:59:17.304403 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-951915c6-c5d0-455d-b885-3c83407c9762 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:59:17.395875 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-951915c6-c5d0-455d-b885-3c83407c9762 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af8fb7f45f4d4eb180ccaca3d52ed2dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dd2b27540c04b4c8741ce8c9a5e2b47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:59:17.405588 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-951915c6-c5d0-455d-b885-3c83407c9762 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] 10.222.0.26 "GET /compute/v2.1/servers/b38da944-08fc-4ef6-bee2-ede7b8829ee8" status: 200 len: 1310 microversion: 2.1 time: 0.121887 Mar 05 02:59:17.406728 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 394/774] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:59:17 2022] GET /compute/v2.1/servers/b38da944-08fc-4ef6-bee2-ede7b8829ee8 => generated 1310 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 02:59:18.423053 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-b0e9b196-c81f-4856-9abf-a78b838d64f6 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:59:18.423868 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-b0e9b196-c81f-4856-9abf-a78b838d64f6 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] [instance: b38da944-08fc-4ef6-bee2-ede7b8829ee8] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:59:18.431299 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-b0e9b196-c81f-4856-9abf-a78b838d64f6 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:59:18.432038 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-b0e9b196-c81f-4856-9abf-a78b838d64f6 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:59:18.433298 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-b0e9b196-c81f-4856-9abf-a78b838d64f6 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:59:18.434213 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-b0e9b196-c81f-4856-9abf-a78b838d64f6 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:59:18.719847 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-b0e9b196-c81f-4856-9abf-a78b838d64f6 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af8fb7f45f4d4eb180ccaca3d52ed2dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dd2b27540c04b4c8741ce8c9a5e2b47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:59:18.728045 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-b0e9b196-c81f-4856-9abf-a78b838d64f6 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] 10.222.0.26 "GET /compute/v2.1/servers/b38da944-08fc-4ef6-bee2-ede7b8829ee8" status: 200 len: 1365 microversion: 2.1 time: 0.308410 Mar 05 02:59:18.728905 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 381/775] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:59:18 2022] GET /compute/v2.1/servers/b38da944-08fc-4ef6-bee2-ede7b8829ee8 => generated 1365 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 02:59:18.863842 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [req-f8141d7e-ac24-4178-82dc-c19e6535b931 req-b542c76c-2e85-423e-925d-a4b15fc2310c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b38da944-08fc-4ef6-bee2-ede7b8829ee8", "tag": "fd5a18a0-9b74-45f1-95e7-b2a51aa4cca3"}]} {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 02:59:18.880052 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [req-f8141d7e-ac24-4178-82dc-c19e6535b931 req-b542c76c-2e85-423e-925d-a4b15fc2310c service nova] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:59:18.885038 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [req-f8141d7e-ac24-4178-82dc-c19e6535b931 req-b542c76c-2e85-423e-925d-a4b15fc2310c service nova] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:59:18.899002 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.compute.server_external_events [req-f8141d7e-ac24-4178-82dc-c19e6535b931 req-b542c76c-2e85-423e-925d-a4b15fc2310c service nova] Creating event network-changed:fd5a18a0-9b74-45f1-95e7-b2a51aa4cca3 for instance b38da944-08fc-4ef6-bee2-ede7b8829ee8 on hv-cinder-82725 Mar 05 02:59:18.906039 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [req-f8141d7e-ac24-4178-82dc-c19e6535b931 req-b542c76c-2e85-423e-925d-a4b15fc2310c service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046721 Mar 05 02:59:18.908208 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 395/776] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Mar 5 02:59:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 02:59:19.746863 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-7af0d715-5454-4525-a180-27190e0154d5 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:59:19.749001 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-7af0d715-5454-4525-a180-27190e0154d5 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] [instance: b38da944-08fc-4ef6-bee2-ede7b8829ee8] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:59:19.756068 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-7af0d715-5454-4525-a180-27190e0154d5 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:59:19.757000 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-7af0d715-5454-4525-a180-27190e0154d5 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:59:19.757338 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-7af0d715-5454-4525-a180-27190e0154d5 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:59:19.757785 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-7af0d715-5454-4525-a180-27190e0154d5 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:59:19.987507 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-7af0d715-5454-4525-a180-27190e0154d5 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af8fb7f45f4d4eb180ccaca3d52ed2dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dd2b27540c04b4c8741ce8c9a5e2b47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:59:19.996341 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-7af0d715-5454-4525-a180-27190e0154d5 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] 10.222.0.26 "GET /compute/v2.1/servers/b38da944-08fc-4ef6-bee2-ede7b8829ee8" status: 200 len: 1365 microversion: 2.1 time: 0.253515 Mar 05 02:59:19.996961 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 382/777] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:59:19 2022] GET /compute/v2.1/servers/b38da944-08fc-4ef6-bee2-ede7b8829ee8 => generated 1365 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 02:59:21.013338 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-22ce6671-5514-4d7d-9137-48c5e11755a8 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:59:21.014064 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-22ce6671-5514-4d7d-9137-48c5e11755a8 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] [instance: b38da944-08fc-4ef6-bee2-ede7b8829ee8] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:59:21.022335 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-22ce6671-5514-4d7d-9137-48c5e11755a8 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:59:21.022792 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-22ce6671-5514-4d7d-9137-48c5e11755a8 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:59:21.023569 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-22ce6671-5514-4d7d-9137-48c5e11755a8 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:59:21.024007 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-22ce6671-5514-4d7d-9137-48c5e11755a8 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:59:21.169473 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-22ce6671-5514-4d7d-9137-48c5e11755a8 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af8fb7f45f4d4eb180ccaca3d52ed2dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dd2b27540c04b4c8741ce8c9a5e2b47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:59:21.178644 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-22ce6671-5514-4d7d-9137-48c5e11755a8 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] 10.222.0.26 "GET /compute/v2.1/servers/b38da944-08fc-4ef6-bee2-ede7b8829ee8" status: 200 len: 1365 microversion: 2.1 time: 0.169819 Mar 05 02:59:21.179217 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 396/778] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:59:21 2022] GET /compute/v2.1/servers/b38da944-08fc-4ef6-bee2-ede7b8829ee8 => generated 1365 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 02:59:22.197878 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-9dcff700-d4d3-42ef-b3a7-5cdaf6e6cd9d tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:59:22.198798 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-9dcff700-d4d3-42ef-b3a7-5cdaf6e6cd9d tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] [instance: b38da944-08fc-4ef6-bee2-ede7b8829ee8] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:59:22.207130 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-9dcff700-d4d3-42ef-b3a7-5cdaf6e6cd9d tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:59:22.208088 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-9dcff700-d4d3-42ef-b3a7-5cdaf6e6cd9d tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:59:22.209195 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-9dcff700-d4d3-42ef-b3a7-5cdaf6e6cd9d tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:59:22.209786 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-9dcff700-d4d3-42ef-b3a7-5cdaf6e6cd9d tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:59:22.447212 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-9dcff700-d4d3-42ef-b3a7-5cdaf6e6cd9d tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af8fb7f45f4d4eb180ccaca3d52ed2dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dd2b27540c04b4c8741ce8c9a5e2b47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:59:22.458863 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-9dcff700-d4d3-42ef-b3a7-5cdaf6e6cd9d tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] 10.222.0.26 "GET /compute/v2.1/servers/b38da944-08fc-4ef6-bee2-ede7b8829ee8" status: 200 len: 1365 microversion: 2.1 time: 0.267352 Mar 05 02:59:22.459465 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 383/779] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:59:22 2022] GET /compute/v2.1/servers/b38da944-08fc-4ef6-bee2-ede7b8829ee8 => generated 1365 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 02:59:22.716533 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-c95bd877-c5df-4f78-99fc-21e64e286c66 tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:59:22.717304 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-c95bd877-c5df-4f78-99fc-21e64e286c66 tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] [instance: ca6cb405-f00a-4fcf-9147-824793f35ebf] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:59:22.717416 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [req-79f36d84-db94-4e13-87c5-8f97ff3720f0 req-183aad97-6f99-4b5a-bc80-e7c43cc8672f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ca6cb405-f00a-4fcf-9147-824793f35ebf", "tag": "6c993446-3f76-4f92-94ad-2054b8a5ebfe"}]} {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 02:59:22.735987 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [req-79f36d84-db94-4e13-87c5-8f97ff3720f0 req-183aad97-6f99-4b5a-bc80-e7c43cc8672f service nova] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:59:22.735987 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [req-79f36d84-db94-4e13-87c5-8f97ff3720f0 req-183aad97-6f99-4b5a-bc80-e7c43cc8672f service nova] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:59:22.740160 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-c95bd877-c5df-4f78-99fc-21e64e286c66 tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:59:22.740813 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-c95bd877-c5df-4f78-99fc-21e64e286c66 tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:59:22.741927 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-c95bd877-c5df-4f78-99fc-21e64e286c66 tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:59:22.742567 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-c95bd877-c5df-4f78-99fc-21e64e286c66 tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:59:22.751815 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.compute.server_external_events [req-79f36d84-db94-4e13-87c5-8f97ff3720f0 req-183aad97-6f99-4b5a-bc80-e7c43cc8672f service nova] Creating event network-changed:6c993446-3f76-4f92-94ad-2054b8a5ebfe for instance ca6cb405-f00a-4fcf-9147-824793f35ebf on hv-cinder-82725 Mar 05 02:59:22.756932 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [req-79f36d84-db94-4e13-87c5-8f97ff3720f0 req-183aad97-6f99-4b5a-bc80-e7c43cc8672f service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043599 Mar 05 02:59:22.757674 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 384/780] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Mar 5 02:59:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 05 02:59:22.774888 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-c95bd877-c5df-4f78-99fc-21e64e286c66 tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] [instance: ca6cb405-f00a-4fcf-9147-824793f35ebf] Going to try to terminate instance {{(pid=123545) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 05 02:59:22.881302 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-c95bd877-c5df-4f78-99fc-21e64e286c66 tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] 10.222.0.26 "DELETE /compute/v2.1/servers/ca6cb405-f00a-4fcf-9147-824793f35ebf" status: 204 len: 0 microversion: 2.1 time: 0.157949 Mar 05 02:59:22.882099 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 397/781] 10.222.0.26 () {58 vars in 1238 bytes} [Sat Mar 5 02:59:22 2022] DELETE /compute/v2.1/servers/ca6cb405-f00a-4fcf-9147-824793f35ebf => generated 0 bytes in 172 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 05 02:59:22.891779 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-a3dc0e53-45ad-4d2f-9835-03ab6cbf89ff tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:59:22.892815 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-a3dc0e53-45ad-4d2f-9835-03ab6cbf89ff tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] [instance: ca6cb405-f00a-4fcf-9147-824793f35ebf] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:59:22.899450 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-a3dc0e53-45ad-4d2f-9835-03ab6cbf89ff tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:59:22.900155 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-a3dc0e53-45ad-4d2f-9835-03ab6cbf89ff tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:59:22.901212 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-a3dc0e53-45ad-4d2f-9835-03ab6cbf89ff tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:59:22.901735 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-a3dc0e53-45ad-4d2f-9835-03ab6cbf89ff tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:59:23.124700 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-a3dc0e53-45ad-4d2f-9835-03ab6cbf89ff tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c68b816379942e282577e3d8d624ae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47835ba5de1a42cc94c09b33a187868a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:59:23.132472 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-a3dc0e53-45ad-4d2f-9835-03ab6cbf89ff tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] 10.222.0.26 "GET /compute/v2.1/servers/ca6cb405-f00a-4fcf-9147-824793f35ebf" status: 200 len: 1569 microversion: 2.1 time: 0.245650 Mar 05 02:59:23.133044 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 385/782] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:59:22 2022] GET /compute/v2.1/servers/ca6cb405-f00a-4fcf-9147-824793f35ebf => generated 1569 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 02:59:23.475946 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-81b5567e-031f-45b4-a02c-0ebd83b4cdc6 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:59:23.476683 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-81b5567e-031f-45b4-a02c-0ebd83b4cdc6 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] [instance: b38da944-08fc-4ef6-bee2-ede7b8829ee8] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:59:23.482779 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-81b5567e-031f-45b4-a02c-0ebd83b4cdc6 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:59:23.483235 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-81b5567e-031f-45b4-a02c-0ebd83b4cdc6 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:59:23.484003 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-81b5567e-031f-45b4-a02c-0ebd83b4cdc6 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:59:23.484450 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-81b5567e-031f-45b4-a02c-0ebd83b4cdc6 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:59:23.620346 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-81b5567e-031f-45b4-a02c-0ebd83b4cdc6 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af8fb7f45f4d4eb180ccaca3d52ed2dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dd2b27540c04b4c8741ce8c9a5e2b47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:59:23.627598 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-81b5567e-031f-45b4-a02c-0ebd83b4cdc6 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] 10.222.0.26 "GET /compute/v2.1/servers/b38da944-08fc-4ef6-bee2-ede7b8829ee8" status: 200 len: 1365 microversion: 2.1 time: 0.155843 Mar 05 02:59:23.628302 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 398/783] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:59:23 2022] GET /compute/v2.1/servers/b38da944-08fc-4ef6-bee2-ede7b8829ee8 => generated 1365 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 02:59:23.696356 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [req-06734dde-c883-4ff5-a329-07ef09ba7988 req-edb4d765-5fa1-4103-803b-90ceeb56a134 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b38da944-08fc-4ef6-bee2-ede7b8829ee8", "name": "network-vif-plugged", "status": "completed", "tag": "fd5a18a0-9b74-45f1-95e7-b2a51aa4cca3"}]} {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 02:59:23.705542 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [req-06734dde-c883-4ff5-a329-07ef09ba7988 req-edb4d765-5fa1-4103-803b-90ceeb56a134 service nova] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:59:23.706154 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [req-06734dde-c883-4ff5-a329-07ef09ba7988 req-edb4d765-5fa1-4103-803b-90ceeb56a134 service nova] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:59:23.718089 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.compute.server_external_events [req-06734dde-c883-4ff5-a329-07ef09ba7988 req-edb4d765-5fa1-4103-803b-90ceeb56a134 service nova] Creating event network-vif-plugged:fd5a18a0-9b74-45f1-95e7-b2a51aa4cca3 for instance b38da944-08fc-4ef6-bee2-ede7b8829ee8 on hv-cinder-82725 Mar 05 02:59:23.722923 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [req-06734dde-c883-4ff5-a329-07ef09ba7988 req-edb4d765-5fa1-4103-803b-90ceeb56a134 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030262 Mar 05 02:59:23.723583 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 386/784] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Mar 5 02:59:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 02:59:24.309264 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-8091a4b6-d646-43f2-9147-9d5a22261fb6 tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:59:24.309876 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-8091a4b6-d646-43f2-9147-9d5a22261fb6 tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] [instance: ca6cb405-f00a-4fcf-9147-824793f35ebf] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:59:24.316758 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-8091a4b6-d646-43f2-9147-9d5a22261fb6 tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:59:24.317256 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-8091a4b6-d646-43f2-9147-9d5a22261fb6 tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:59:24.318082 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-8091a4b6-d646-43f2-9147-9d5a22261fb6 tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:59:24.318514 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-8091a4b6-d646-43f2-9147-9d5a22261fb6 tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:59:24.481588 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-8091a4b6-d646-43f2-9147-9d5a22261fb6 tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c68b816379942e282577e3d8d624ae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47835ba5de1a42cc94c09b33a187868a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:59:24.489920 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-8091a4b6-d646-43f2-9147-9d5a22261fb6 tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] 10.222.0.26 "GET /compute/v2.1/servers/ca6cb405-f00a-4fcf-9147-824793f35ebf" status: 200 len: 1451 microversion: 2.1 time: 0.343770 Mar 05 02:59:24.490505 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 399/785] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:59:24 2022] GET /compute/v2.1/servers/ca6cb405-f00a-4fcf-9147-824793f35ebf => generated 1451 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 02:59:24.644556 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-d80ab7b6-2885-4752-b67b-2fdb6be5efaa tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:59:24.645249 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-d80ab7b6-2885-4752-b67b-2fdb6be5efaa tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] [instance: b38da944-08fc-4ef6-bee2-ede7b8829ee8] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:59:24.651187 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-d80ab7b6-2885-4752-b67b-2fdb6be5efaa tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:59:24.651636 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-d80ab7b6-2885-4752-b67b-2fdb6be5efaa tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:59:24.652402 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-d80ab7b6-2885-4752-b67b-2fdb6be5efaa tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:59:24.652832 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-d80ab7b6-2885-4752-b67b-2fdb6be5efaa tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:59:24.793076 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-d80ab7b6-2885-4752-b67b-2fdb6be5efaa tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af8fb7f45f4d4eb180ccaca3d52ed2dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dd2b27540c04b4c8741ce8c9a5e2b47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:59:24.801725 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-d80ab7b6-2885-4752-b67b-2fdb6be5efaa tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] 10.222.0.26 "GET /compute/v2.1/servers/b38da944-08fc-4ef6-bee2-ede7b8829ee8" status: 200 len: 1365 microversion: 2.1 time: 0.161402 Mar 05 02:59:24.802342 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 387/786] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:59:24 2022] GET /compute/v2.1/servers/b38da944-08fc-4ef6-bee2-ede7b8829ee8 => generated 1365 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 02:59:25.396346 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [req-8c7b8840-2976-4f1a-8bfb-f96ac0a93496 req-ccac15f9-86d2-4bfe-be09-b010a9f8ac0f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca6cb405-f00a-4fcf-9147-824793f35ebf", "name": "network-vif-deleted", "tag": "6c993446-3f76-4f92-94ad-2054b8a5ebfe"}]} {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 02:59:25.405757 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [req-8c7b8840-2976-4f1a-8bfb-f96ac0a93496 req-ccac15f9-86d2-4bfe-be09-b010a9f8ac0f service nova] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:59:25.406096 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [req-8c7b8840-2976-4f1a-8bfb-f96ac0a93496 req-ccac15f9-86d2-4bfe-be09-b010a9f8ac0f service nova] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:59:25.417582 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.compute.server_external_events [req-8c7b8840-2976-4f1a-8bfb-f96ac0a93496 req-ccac15f9-86d2-4bfe-be09-b010a9f8ac0f service nova] Creating event network-vif-deleted:6c993446-3f76-4f92-94ad-2054b8a5ebfe for instance ca6cb405-f00a-4fcf-9147-824793f35ebf on hv-cinder-82725 Mar 05 02:59:25.424318 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [req-8c7b8840-2976-4f1a-8bfb-f96ac0a93496 req-ccac15f9-86d2-4bfe-be09-b010a9f8ac0f service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031399 Mar 05 02:59:25.425484 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 400/787] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Mar 5 02:59:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 02:59:25.507093 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-47d162d9-24ec-4e14-80ef-977afdbfe3d5 tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:59:25.507731 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-47d162d9-24ec-4e14-80ef-977afdbfe3d5 tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] [instance: ca6cb405-f00a-4fcf-9147-824793f35ebf] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:59:25.513824 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-47d162d9-24ec-4e14-80ef-977afdbfe3d5 tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:59:25.514297 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-47d162d9-24ec-4e14-80ef-977afdbfe3d5 tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:59:25.515059 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-47d162d9-24ec-4e14-80ef-977afdbfe3d5 tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:59:25.515539 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-47d162d9-24ec-4e14-80ef-977afdbfe3d5 tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:59:25.581419 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-47d162d9-24ec-4e14-80ef-977afdbfe3d5 tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c68b816379942e282577e3d8d624ae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47835ba5de1a42cc94c09b33a187868a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:59:25.589763 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-47d162d9-24ec-4e14-80ef-977afdbfe3d5 tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] 10.222.0.26 "GET /compute/v2.1/servers/ca6cb405-f00a-4fcf-9147-824793f35ebf" status: 200 len: 1219 microversion: 2.1 time: 0.086685 Mar 05 02:59:25.590351 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 388/788] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:59:25 2022] GET /compute/v2.1/servers/ca6cb405-f00a-4fcf-9147-824793f35ebf => generated 1219 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 02:59:25.819601 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-da203eef-03a2-4431-ab69-eb09429a98b5 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:59:25.820453 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-da203eef-03a2-4431-ab69-eb09429a98b5 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] [instance: b38da944-08fc-4ef6-bee2-ede7b8829ee8] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:59:25.831689 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-da203eef-03a2-4431-ab69-eb09429a98b5 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:59:25.832428 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-da203eef-03a2-4431-ab69-eb09429a98b5 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:59:25.833400 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-da203eef-03a2-4431-ab69-eb09429a98b5 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:59:25.834041 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-da203eef-03a2-4431-ab69-eb09429a98b5 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:59:25.991098 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-da203eef-03a2-4431-ab69-eb09429a98b5 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af8fb7f45f4d4eb180ccaca3d52ed2dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dd2b27540c04b4c8741ce8c9a5e2b47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 02:59:25.998460 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-da203eef-03a2-4431-ab69-eb09429a98b5 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] 10.222.0.26 "GET /compute/v2.1/servers/b38da944-08fc-4ef6-bee2-ede7b8829ee8" status: 200 len: 1554 microversion: 2.1 time: 0.183876 Mar 05 02:59:25.999016 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 401/789] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:59:25 2022] GET /compute/v2.1/servers/b38da944-08fc-4ef6-bee2-ede7b8829ee8 => generated 1554 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 02:59:26.014981 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-54c5dfb1-fda3-42f2-ba5a-bb5fdf1b90a6 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:59:26.015623 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-54c5dfb1-fda3-42f2-ba5a-bb5fdf1b90a6 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] [instance: b38da944-08fc-4ef6-bee2-ede7b8829ee8] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:59:26.024686 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-54c5dfb1-fda3-42f2-ba5a-bb5fdf1b90a6 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:59:26.025239 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-54c5dfb1-fda3-42f2-ba5a-bb5fdf1b90a6 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:59:26.026295 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-54c5dfb1-fda3-42f2-ba5a-bb5fdf1b90a6 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:59:26.026879 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-54c5dfb1-fda3-42f2-ba5a-bb5fdf1b90a6 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:59:26.120534 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-54c5dfb1-fda3-42f2-ba5a-bb5fdf1b90a6 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] 10.222.0.26 "GET /compute/v2.1/servers/b38da944-08fc-4ef6-bee2-ede7b8829ee8/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.109438 Mar 05 02:59:26.121251 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 389/790] 10.222.0.26 () {58 vars in 1274 bytes} [Sat Mar 5 02:59:26 2022] GET /compute/v2.1/servers/b38da944-08fc-4ef6-bee2-ede7b8829ee8/os-interface => generated 284 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 02:59:26.608115 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-fe1e954a-d9f2-45b5-93b8-f05a53f46f80 tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:59:26.608871 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-fe1e954a-d9f2-45b5-93b8-f05a53f46f80 tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] [instance: ca6cb405-f00a-4fcf-9147-824793f35ebf] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 02:59:26.616007 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-fe1e954a-d9f2-45b5-93b8-f05a53f46f80 tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:59:26.616660 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-fe1e954a-d9f2-45b5-93b8-f05a53f46f80 tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:59:26.617935 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-fe1e954a-d9f2-45b5-93b8-f05a53f46f80 tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:59:26.618853 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-fe1e954a-d9f2-45b5-93b8-f05a53f46f80 tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:59:26.637969 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.wsgi [None req-fe1e954a-d9f2-45b5-93b8-f05a53f46f80 tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] HTTP exception thrown: Instance ca6cb405-f00a-4fcf-9147-824793f35ebf could not be found. Mar 05 02:59:26.639129 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-fe1e954a-d9f2-45b5-93b8-f05a53f46f80 tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] Returning 404 to user: Instance ca6cb405-f00a-4fcf-9147-824793f35ebf could not be found. {{(pid=123545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 02:59:26.640201 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-fe1e954a-d9f2-45b5-93b8-f05a53f46f80 tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] 10.222.0.26 "GET /compute/v2.1/servers/ca6cb405-f00a-4fcf-9147-824793f35ebf" status: 404 len: 111 microversion: 2.1 time: 0.036410 Mar 05 02:59:26.641495 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 402/791] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 02:59:26 2022] GET /compute/v2.1/servers/ca6cb405-f00a-4fcf-9147-824793f35ebf => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 05 02:59:26.843648 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-10cb4d2b-bfd5-49dd-b6e5-ce170ec401d6 tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] Calling method '.version_select at 0x7f3f61c97c10>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 02:59:26.874136 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-10cb4d2b-bfd5-49dd-b6e5-ce170ec401d6 tempest-TestShelveInstance-746525427 tempest-TestShelveInstance-746525427-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-320980881" status: 202 len: 0 microversion: 2.1 time: 0.033911 Mar 05 02:59:26.880264 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 390/792] 10.222.0.26 () {58 vars in 1250 bytes} [Sat Mar 5 02:59:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-320980881 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 05 02:59:27.546383 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [req-9dff221e-65eb-4e79-b7bd-491381d1244a req-0f9b86ae-ce3e-40a9-996b-952e780a3e22 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b38da944-08fc-4ef6-bee2-ede7b8829ee8", "tag": "fd5a18a0-9b74-45f1-95e7-b2a51aa4cca3"}]} {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 02:59:27.552967 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [req-9dff221e-65eb-4e79-b7bd-491381d1244a req-0f9b86ae-ce3e-40a9-996b-952e780a3e22 service nova] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 02:59:27.553412 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [req-9dff221e-65eb-4e79-b7bd-491381d1244a req-0f9b86ae-ce3e-40a9-996b-952e780a3e22 service nova] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 02:59:27.564820 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.compute.server_external_events [req-9dff221e-65eb-4e79-b7bd-491381d1244a req-0f9b86ae-ce3e-40a9-996b-952e780a3e22 service nova] Creating event network-changed:fd5a18a0-9b74-45f1-95e7-b2a51aa4cca3 for instance b38da944-08fc-4ef6-bee2-ede7b8829ee8 on hv-cinder-82725 Mar 05 02:59:27.569858 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [req-9dff221e-65eb-4e79-b7bd-491381d1244a req-0f9b86ae-ce3e-40a9-996b-952e780a3e22 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029613 Mar 05 02:59:27.570482 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 403/793] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Mar 5 02:59:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 02:59:58.043084 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-6b358c8b-c3d4-4284-abff-f1038197284c tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Action: 'create', calling method: .version_select at 0x7f3f61cb3550>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1345238013"}} {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 02:59:58.070560 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.quota [None req-6b358c8b-c3d4-4284-abff-f1038197284c tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Getting quotas for project 71e08e745e374d92a13f0a03ad69b496. Resources: {'key_pairs'} {{(pid=123546) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 02:59:58.076707 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.quota [None req-6b358c8b-c3d4-4284-abff-f1038197284c tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Getting quotas for user d53fb7a6cf8b4d47a871ee2a1a24d21f and project 71e08e745e374d92a13f0a03ad69b496. Resources: {'key_pairs'} {{(pid=123546) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 02:59:58.428231 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.quota [None req-6b358c8b-c3d4-4284-abff-f1038197284c tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Getting quotas for project 71e08e745e374d92a13f0a03ad69b496. Resources: {'key_pairs'} {{(pid=123546) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 02:59:58.432282 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.quota [None req-6b358c8b-c3d4-4284-abff-f1038197284c tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Getting quotas for user d53fb7a6cf8b4d47a871ee2a1a24d21f and project 71e08e745e374d92a13f0a03ad69b496. Resources: {'key_pairs'} {{(pid=123546) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 02:59:58.456559 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-6b358c8b-c3d4-4284-abff-f1038197284c tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 2315 microversion: 2.1 time: 0.724174 Mar 05 02:59:58.457333 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 391/794] 10.222.0.26 () {60 vars in 1157 bytes} [Sat Mar 5 02:59:57 2022] POST /compute/v2.1/os-keypairs => generated 2315 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 02:59:59.366027 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-e9b203f9-27cb-4a11-b27e-660de3b10003 tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] Action: 'create', calling method: .version_select at 0x7f3f61d41160>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1735903554"}} {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 02:59:59.388462 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.quota [None req-e9b203f9-27cb-4a11-b27e-660de3b10003 tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] Getting quotas for project afdf34f696b743d1885e8c9895a1d4b0. Resources: {'key_pairs'} {{(pid=123545) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 02:59:59.394919 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.quota [None req-e9b203f9-27cb-4a11-b27e-660de3b10003 tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] Getting quotas for user 18be544fa93d45b5866e5457c92cbeed and project afdf34f696b743d1885e8c9895a1d4b0. Resources: {'key_pairs'} {{(pid=123545) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 02:59:59.556022 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.quota [None req-e9b203f9-27cb-4a11-b27e-660de3b10003 tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] Getting quotas for project afdf34f696b743d1885e8c9895a1d4b0. Resources: {'key_pairs'} {{(pid=123545) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 02:59:59.559807 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.quota [None req-e9b203f9-27cb-4a11-b27e-660de3b10003 tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] Getting quotas for user 18be544fa93d45b5866e5457c92cbeed and project afdf34f696b743d1885e8c9895a1d4b0. Resources: {'key_pairs'} {{(pid=123545) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 02:59:59.574035 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-e9b203f9-27cb-4a11-b27e-660de3b10003 tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 2322 microversion: 2.1 time: 0.213099 Mar 05 02:59:59.574803 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 404/795] 10.222.0.26 () {60 vars in 1157 bytes} [Sat Mar 5 02:59:59 2022] POST /compute/v2.1/os-keypairs => generated 2322 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 02:59:59.699115 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-6f1ba674-60f8-4e58-8120-2ec946a40f11 tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1244109126", "imageRef": "4e1000f5-da18-41eb-a7fa-18552d46debf", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1735903554", "networks": [{"uuid": "332d66d3-287a-4b41-876a-1fa0526c39de"}]}} {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 02:59:59.762169 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.network.neutron [None req-6f1ba674-60f8-4e58-8120-2ec946a40f11 tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] validate_networks() for [('332d66d3-287a-4b41-876a-1fa0526c39de', None, None, None, None, None)] {{(pid=123546) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 05 03:00:00.161119 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.virt.hardware [None req-6f1ba674-60f8-4e58-8120-2ec946a40f11 tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] Flavor limits 0:0:0 {{(pid=123546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 05 03:00:00.161591 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.virt.hardware [None req-6f1ba674-60f8-4e58-8120-2ec946a40f11 tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] Image limits 0:0:0 {{(pid=123546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 05 03:00:00.162102 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.virt.hardware [None req-6f1ba674-60f8-4e58-8120-2ec946a40f11 tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] Flavor pref 0:0:0 {{(pid=123546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 05 03:00:00.162518 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.virt.hardware [None req-6f1ba674-60f8-4e58-8120-2ec946a40f11 tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] Image pref 0:0:0 {{(pid=123546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 05 03:00:00.162943 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.virt.hardware [None req-6f1ba674-60f8-4e58-8120-2ec946a40f11 tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 05 03:00:00.172450 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-6f1ba674-60f8-4e58-8120-2ec946a40f11 tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 03:00:00.172895 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-6f1ba674-60f8-4e58-8120-2ec946a40f11 tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 03:00:00.173717 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-6f1ba674-60f8-4e58-8120-2ec946a40f11 tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 03:00:00.174175 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-6f1ba674-60f8-4e58-8120-2ec946a40f11 tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 03:00:00.190684 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.quota [None req-6f1ba674-60f8-4e58-8120-2ec946a40f11 tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] Getting quotas for project afdf34f696b743d1885e8c9895a1d4b0. Resources: {'ram', 'cores', 'instances'} {{(pid=123546) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 03:00:00.194531 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.quota [None req-6f1ba674-60f8-4e58-8120-2ec946a40f11 tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] Getting quotas for user 18be544fa93d45b5866e5457c92cbeed and project afdf34f696b743d1885e8c9895a1d4b0. Resources: {'ram', 'cores', 'instances'} {{(pid=123546) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 03:00:00.207018 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-6f1ba674-60f8-4e58-8120-2ec946a40f11 tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] Going to run 1 instances... {{(pid=123546) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 05 03:00:00.209286 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-6f1ba674-60f8-4e58-8120-2ec946a40f11 tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] [instance: 7a5dd9d2-a5d0-49a4-bc75-727de7076c66] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4e1000f5-da18-41eb-a7fa-18552d46debf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123546) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 05 03:00:00.262578 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-6f1ba674-60f8-4e58-8120-2ec946a40f11 tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.567422 Mar 05 03:00:00.266238 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 392/796] 10.222.0.26 () {60 vars in 1146 bytes} [Sat Mar 5 02:59:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 569 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 05 03:00:00.274050 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-9d72b4d6-3297-4938-afd3-406019adcb89 tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 03:00:00.274959 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-9d72b4d6-3297-4938-afd3-406019adcb89 tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] [instance: 7a5dd9d2-a5d0-49a4-bc75-727de7076c66] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 03:00:00.335569 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-9d72b4d6-3297-4938-afd3-406019adcb89 tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18be544fa93d45b5866e5457c92cbeed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afdf34f696b743d1885e8c9895a1d4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 03:00:00.343023 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-9d72b4d6-3297-4938-afd3-406019adcb89 tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] 10.222.0.26 "GET /compute/v2.1/servers/7a5dd9d2-a5d0-49a4-bc75-727de7076c66" status: 200 len: 1259 microversion: 2.1 time: 0.073266 Mar 05 03:00:00.353304 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 405/797] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 03:00:00 2022] GET /compute/v2.1/servers/7a5dd9d2-a5d0-49a4-bc75-727de7076c66 => generated 1259 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 03:00:01.360897 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-2962942c-1718-4486-9261-b33555432de0 tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 03:00:01.361516 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-2962942c-1718-4486-9261-b33555432de0 tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] [instance: 7a5dd9d2-a5d0-49a4-bc75-727de7076c66] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 03:00:01.368695 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-2962942c-1718-4486-9261-b33555432de0 tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 03:00:01.369387 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-2962942c-1718-4486-9261-b33555432de0 tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 03:00:01.370426 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-2962942c-1718-4486-9261-b33555432de0 tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 03:00:01.370857 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-2962942c-1718-4486-9261-b33555432de0 tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 03:00:01.496399 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-2962942c-1718-4486-9261-b33555432de0 tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18be544fa93d45b5866e5457c92cbeed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afdf34f696b743d1885e8c9895a1d4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 03:00:01.506991 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-2962942c-1718-4486-9261-b33555432de0 tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] 10.222.0.26 "GET /compute/v2.1/servers/7a5dd9d2-a5d0-49a4-bc75-727de7076c66" status: 200 len: 1319 microversion: 2.1 time: 0.149851 Mar 05 03:00:01.521566 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 393/798] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 03:00:01 2022] GET /compute/v2.1/servers/7a5dd9d2-a5d0-49a4-bc75-727de7076c66 => generated 1319 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 03:00:02.527997 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-12d6726b-0ba4-4e7e-95ab-533d6a543b11 tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 03:00:02.529366 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-12d6726b-0ba4-4e7e-95ab-533d6a543b11 tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] [instance: 7a5dd9d2-a5d0-49a4-bc75-727de7076c66] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 03:00:02.539541 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-12d6726b-0ba4-4e7e-95ab-533d6a543b11 tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 03:00:02.544027 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-12d6726b-0ba4-4e7e-95ab-533d6a543b11 tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 03:00:02.544981 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-12d6726b-0ba4-4e7e-95ab-533d6a543b11 tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 03:00:02.545531 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-12d6726b-0ba4-4e7e-95ab-533d6a543b11 tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 03:00:02.570412 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-fd8370b9-2351-4ad3-a7fe-fbe35a36416b tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 03:00:02.571066 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-fd8370b9-2351-4ad3-a7fe-fbe35a36416b tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] [instance: b38da944-08fc-4ef6-bee2-ede7b8829ee8] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 03:00:02.585280 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-fd8370b9-2351-4ad3-a7fe-fbe35a36416b tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 03:00:02.585920 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-fd8370b9-2351-4ad3-a7fe-fbe35a36416b tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 03:00:02.586931 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-fd8370b9-2351-4ad3-a7fe-fbe35a36416b tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 03:00:02.590044 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-fd8370b9-2351-4ad3-a7fe-fbe35a36416b tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 03:00:02.680181 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-fd8370b9-2351-4ad3-a7fe-fbe35a36416b tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] 10.222.0.26 "GET /compute/v2.1/servers/b38da944-08fc-4ef6-bee2-ede7b8829ee8/ips" status: 200 len: 147 microversion: 2.1 time: 0.114202 Mar 05 03:00:02.690221 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 394/799] 10.222.0.26 () {58 vars in 1247 bytes} [Sat Mar 5 03:00:02 2022] GET /compute/v2.1/servers/b38da944-08fc-4ef6-bee2-ede7b8829ee8/ips => generated 147 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 03:00:03.152462 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-12d6726b-0ba4-4e7e-95ab-533d6a543b11 tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18be544fa93d45b5866e5457c92cbeed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afdf34f696b743d1885e8c9895a1d4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 03:00:03.168522 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-12d6726b-0ba4-4e7e-95ab-533d6a543b11 tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] 10.222.0.26 "GET /compute/v2.1/servers/7a5dd9d2-a5d0-49a4-bc75-727de7076c66" status: 200 len: 1359 microversion: 2.1 time: 0.646238 Mar 05 03:00:03.169108 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 406/800] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 03:00:02 2022] GET /compute/v2.1/servers/7a5dd9d2-a5d0-49a4-bc75-727de7076c66 => generated 1359 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 03:00:03.801100 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [req-c8050628-5e88-41b3-989d-64329087427b req-35376658-7e46-4a00-9983-c28fde8777e2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7a5dd9d2-a5d0-49a4-bc75-727de7076c66", "tag": "789f23b9-7562-4e04-91c4-acdf502fe56a"}]} {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 03:00:03.816706 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [req-c8050628-5e88-41b3-989d-64329087427b req-35376658-7e46-4a00-9983-c28fde8777e2 service nova] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 03:00:03.818206 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [req-c8050628-5e88-41b3-989d-64329087427b req-35376658-7e46-4a00-9983-c28fde8777e2 service nova] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 03:00:03.853670 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.compute.server_external_events [req-c8050628-5e88-41b3-989d-64329087427b req-35376658-7e46-4a00-9983-c28fde8777e2 service nova] Creating event network-changed:789f23b9-7562-4e04-91c4-acdf502fe56a for instance 7a5dd9d2-a5d0-49a4-bc75-727de7076c66 on hv-cinder-82725 Mar 05 03:00:03.870274 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [req-c8050628-5e88-41b3-989d-64329087427b req-35376658-7e46-4a00-9983-c28fde8777e2 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072392 Mar 05 03:00:03.880650 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 395/801] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Mar 5 03:00:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 03:00:04.194288 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-fe5bbb11-c431-4701-8ac8-5d14855bcf11 tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 03:00:04.194987 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-fe5bbb11-c431-4701-8ac8-5d14855bcf11 tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] [instance: 7a5dd9d2-a5d0-49a4-bc75-727de7076c66] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 03:00:04.210256 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-fe5bbb11-c431-4701-8ac8-5d14855bcf11 tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 03:00:04.210788 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-fe5bbb11-c431-4701-8ac8-5d14855bcf11 tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 03:00:04.213783 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-fe5bbb11-c431-4701-8ac8-5d14855bcf11 tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 03:00:04.214531 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-fe5bbb11-c431-4701-8ac8-5d14855bcf11 tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 03:00:04.287585 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-7454d3d1-c65c-4424-bf65-3aa7d07c5981 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "510e860b-f52c-45ac-a3d6-2f26b5a26a77"}} {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 03:00:04.289073 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-7454d3d1-c65c-4424-bf65-3aa7d07c5981 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] [instance: b38da944-08fc-4ef6-bee2-ede7b8829ee8] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 03:00:04.295838 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-7454d3d1-c65c-4424-bf65-3aa7d07c5981 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 03:00:04.301202 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-7454d3d1-c65c-4424-bf65-3aa7d07c5981 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 03:00:04.302365 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-7454d3d1-c65c-4424-bf65-3aa7d07c5981 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 03:00:04.302972 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-7454d3d1-c65c-4424-bf65-3aa7d07c5981 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 03:00:04.447527 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-fe5bbb11-c431-4701-8ac8-5d14855bcf11 tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18be544fa93d45b5866e5457c92cbeed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afdf34f696b743d1885e8c9895a1d4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 03:00:04.455897 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-fe5bbb11-c431-4701-8ac8-5d14855bcf11 tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] 10.222.0.26 "GET /compute/v2.1/servers/7a5dd9d2-a5d0-49a4-bc75-727de7076c66" status: 200 len: 1359 microversion: 2.1 time: 0.271747 Mar 05 03:00:04.456953 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 407/802] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 03:00:04 2022] GET /compute/v2.1/servers/7a5dd9d2-a5d0-49a4-bc75-727de7076c66 => generated 1359 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 03:00:05.473940 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-89ea00ec-1390-4e8c-8ec3-28b20cb02fb0 tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 03:00:05.474813 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-89ea00ec-1390-4e8c-8ec3-28b20cb02fb0 tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] [instance: 7a5dd9d2-a5d0-49a4-bc75-727de7076c66] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 03:00:05.481719 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-89ea00ec-1390-4e8c-8ec3-28b20cb02fb0 tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 03:00:05.482365 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-89ea00ec-1390-4e8c-8ec3-28b20cb02fb0 tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 03:00:05.483444 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-89ea00ec-1390-4e8c-8ec3-28b20cb02fb0 tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 03:00:05.484377 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-89ea00ec-1390-4e8c-8ec3-28b20cb02fb0 tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 03:00:05.632175 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-89ea00ec-1390-4e8c-8ec3-28b20cb02fb0 tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18be544fa93d45b5866e5457c92cbeed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afdf34f696b743d1885e8c9895a1d4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 03:00:05.640563 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-89ea00ec-1390-4e8c-8ec3-28b20cb02fb0 tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] 10.222.0.26 "GET /compute/v2.1/servers/7a5dd9d2-a5d0-49a4-bc75-727de7076c66" status: 200 len: 1359 microversion: 2.1 time: 0.170033 Mar 05 03:00:05.641305 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 408/803] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 03:00:05 2022] GET /compute/v2.1/servers/7a5dd9d2-a5d0-49a4-bc75-727de7076c66 => generated 1359 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 03:00:06.659967 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-27bd15f8-b710-4bcb-9298-9a20b172fc9e tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 03:00:06.661589 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-27bd15f8-b710-4bcb-9298-9a20b172fc9e tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] [instance: 7a5dd9d2-a5d0-49a4-bc75-727de7076c66] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 03:00:06.669116 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-27bd15f8-b710-4bcb-9298-9a20b172fc9e tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 03:00:06.669577 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-27bd15f8-b710-4bcb-9298-9a20b172fc9e tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 03:00:06.670470 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-27bd15f8-b710-4bcb-9298-9a20b172fc9e tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 03:00:06.670946 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-27bd15f8-b710-4bcb-9298-9a20b172fc9e tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 03:00:06.824269 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-27bd15f8-b710-4bcb-9298-9a20b172fc9e tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18be544fa93d45b5866e5457c92cbeed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afdf34f696b743d1885e8c9895a1d4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 03:00:06.832886 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-27bd15f8-b710-4bcb-9298-9a20b172fc9e tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] 10.222.0.26 "GET /compute/v2.1/servers/7a5dd9d2-a5d0-49a4-bc75-727de7076c66" status: 200 len: 1359 microversion: 2.1 time: 0.176724 Mar 05 03:00:06.833723 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 409/804] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 03:00:06 2022] GET /compute/v2.1/servers/7a5dd9d2-a5d0-49a4-bc75-727de7076c66 => generated 1359 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 03:00:07.850429 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-71c34031-0d37-4526-89e7-b8b80fa649b2 tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 03:00:07.851068 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-71c34031-0d37-4526-89e7-b8b80fa649b2 tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] [instance: 7a5dd9d2-a5d0-49a4-bc75-727de7076c66] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 03:00:07.857552 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-71c34031-0d37-4526-89e7-b8b80fa649b2 tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 03:00:07.858041 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-71c34031-0d37-4526-89e7-b8b80fa649b2 tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 03:00:07.859403 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-71c34031-0d37-4526-89e7-b8b80fa649b2 tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 03:00:07.859831 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-71c34031-0d37-4526-89e7-b8b80fa649b2 tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 03:00:08.008147 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-71c34031-0d37-4526-89e7-b8b80fa649b2 tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18be544fa93d45b5866e5457c92cbeed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afdf34f696b743d1885e8c9895a1d4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 03:00:08.016452 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-71c34031-0d37-4526-89e7-b8b80fa649b2 tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] 10.222.0.26 "GET /compute/v2.1/servers/7a5dd9d2-a5d0-49a4-bc75-727de7076c66" status: 200 len: 1359 microversion: 2.1 time: 0.169947 Mar 05 03:00:08.017024 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 410/805] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 03:00:07 2022] GET /compute/v2.1/servers/7a5dd9d2-a5d0-49a4-bc75-727de7076c66 => generated 1359 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 03:00:09.036675 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-7568b6a5-a87e-4612-b538-791fbf339edf tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 03:00:09.038199 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-7568b6a5-a87e-4612-b538-791fbf339edf tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] [instance: 7a5dd9d2-a5d0-49a4-bc75-727de7076c66] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 03:00:09.049865 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-7568b6a5-a87e-4612-b538-791fbf339edf tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 03:00:09.050948 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-7568b6a5-a87e-4612-b538-791fbf339edf tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 03:00:09.052539 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-7568b6a5-a87e-4612-b538-791fbf339edf tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 03:00:09.053502 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-7568b6a5-a87e-4612-b538-791fbf339edf tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 03:00:09.220457 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-7568b6a5-a87e-4612-b538-791fbf339edf tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18be544fa93d45b5866e5457c92cbeed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afdf34f696b743d1885e8c9895a1d4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 03:00:09.227912 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-7568b6a5-a87e-4612-b538-791fbf339edf tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] 10.222.0.26 "GET /compute/v2.1/servers/7a5dd9d2-a5d0-49a4-bc75-727de7076c66" status: 200 len: 1359 microversion: 2.1 time: 0.198425 Mar 05 03:00:09.228475 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 411/806] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 03:00:09 2022] GET /compute/v2.1/servers/7a5dd9d2-a5d0-49a4-bc75-727de7076c66 => generated 1359 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 03:00:10.252432 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-18ddebf6-01c3-49f7-99e0-daedd83bb2f7 tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 03:00:10.253232 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-18ddebf6-01c3-49f7-99e0-daedd83bb2f7 tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] [instance: 7a5dd9d2-a5d0-49a4-bc75-727de7076c66] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 03:00:10.259823 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-18ddebf6-01c3-49f7-99e0-daedd83bb2f7 tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 03:00:10.260482 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-18ddebf6-01c3-49f7-99e0-daedd83bb2f7 tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 03:00:10.261456 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-18ddebf6-01c3-49f7-99e0-daedd83bb2f7 tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 03:00:10.262075 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-18ddebf6-01c3-49f7-99e0-daedd83bb2f7 tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 03:00:10.423525 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-18ddebf6-01c3-49f7-99e0-daedd83bb2f7 tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18be544fa93d45b5866e5457c92cbeed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afdf34f696b743d1885e8c9895a1d4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 03:00:10.431025 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-18ddebf6-01c3-49f7-99e0-daedd83bb2f7 tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] 10.222.0.26 "GET /compute/v2.1/servers/7a5dd9d2-a5d0-49a4-bc75-727de7076c66" status: 200 len: 1359 microversion: 2.1 time: 0.183764 Mar 05 03:00:10.431601 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 412/807] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 03:00:10 2022] GET /compute/v2.1/servers/7a5dd9d2-a5d0-49a4-bc75-727de7076c66 => generated 1359 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 03:00:11.325566 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-7454d3d1-c65c-4424-bf65-3aa7d07c5981 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] 10.222.0.26 "POST /compute/v2.1/servers/b38da944-08fc-4ef6-bee2-ede7b8829ee8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 7.042090 Mar 05 03:00:11.326384 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 396/808] 10.222.0.26 () {60 vars in 1322 bytes} [Sat Mar 5 03:00:04 2022] POST /compute/v2.1/servers/b38da944-08fc-4ef6-bee2-ede7b8829ee8/os-volume_attachments => generated 194 bytes in 7044 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 03:00:11.448628 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-72931c9b-e4bb-49ae-966f-6858effe3cd4 tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 03:00:11.449351 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-72931c9b-e4bb-49ae-966f-6858effe3cd4 tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] [instance: 7a5dd9d2-a5d0-49a4-bc75-727de7076c66] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 03:00:11.457542 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-72931c9b-e4bb-49ae-966f-6858effe3cd4 tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 03:00:11.458101 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-72931c9b-e4bb-49ae-966f-6858effe3cd4 tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 03:00:11.459092 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-72931c9b-e4bb-49ae-966f-6858effe3cd4 tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 03:00:11.459535 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-72931c9b-e4bb-49ae-966f-6858effe3cd4 tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 03:00:11.690961 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-72931c9b-e4bb-49ae-966f-6858effe3cd4 tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18be544fa93d45b5866e5457c92cbeed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afdf34f696b743d1885e8c9895a1d4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 03:00:11.698889 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-72931c9b-e4bb-49ae-966f-6858effe3cd4 tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] 10.222.0.26 "GET /compute/v2.1/servers/7a5dd9d2-a5d0-49a4-bc75-727de7076c66" status: 200 len: 1359 microversion: 2.1 time: 0.253312 Mar 05 03:00:11.699645 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 413/809] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 03:00:11 2022] GET /compute/v2.1/servers/7a5dd9d2-a5d0-49a4-bc75-727de7076c66 => generated 1359 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 03:00:12.717861 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-845f7bad-72e9-4f72-ad1b-ec5e99f26bac tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 03:00:12.718714 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-845f7bad-72e9-4f72-ad1b-ec5e99f26bac tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] [instance: 7a5dd9d2-a5d0-49a4-bc75-727de7076c66] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 03:00:12.725557 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-845f7bad-72e9-4f72-ad1b-ec5e99f26bac tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 03:00:12.726039 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-845f7bad-72e9-4f72-ad1b-ec5e99f26bac tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 03:00:12.726823 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-845f7bad-72e9-4f72-ad1b-ec5e99f26bac tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 03:00:12.727547 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-845f7bad-72e9-4f72-ad1b-ec5e99f26bac tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 03:00:12.868626 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-845f7bad-72e9-4f72-ad1b-ec5e99f26bac tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18be544fa93d45b5866e5457c92cbeed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afdf34f696b743d1885e8c9895a1d4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 03:00:12.876314 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-845f7bad-72e9-4f72-ad1b-ec5e99f26bac tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] 10.222.0.26 "GET /compute/v2.1/servers/7a5dd9d2-a5d0-49a4-bc75-727de7076c66" status: 200 len: 1359 microversion: 2.1 time: 0.163381 Mar 05 03:00:12.877074 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 397/810] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 03:00:12 2022] GET /compute/v2.1/servers/7a5dd9d2-a5d0-49a4-bc75-727de7076c66 => generated 1359 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 03:00:13.894183 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-a98bb2f3-5e01-4bf5-a0d7-c85b87c610d5 tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 03:00:13.894793 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-a98bb2f3-5e01-4bf5-a0d7-c85b87c610d5 tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] [instance: 7a5dd9d2-a5d0-49a4-bc75-727de7076c66] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 03:00:13.901419 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-a98bb2f3-5e01-4bf5-a0d7-c85b87c610d5 tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 03:00:13.902085 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-a98bb2f3-5e01-4bf5-a0d7-c85b87c610d5 tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 03:00:13.903048 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-a98bb2f3-5e01-4bf5-a0d7-c85b87c610d5 tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 03:00:13.903654 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-a98bb2f3-5e01-4bf5-a0d7-c85b87c610d5 tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 03:00:14.060677 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-a98bb2f3-5e01-4bf5-a0d7-c85b87c610d5 tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18be544fa93d45b5866e5457c92cbeed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afdf34f696b743d1885e8c9895a1d4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 03:00:14.068601 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-a98bb2f3-5e01-4bf5-a0d7-c85b87c610d5 tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] 10.222.0.26 "GET /compute/v2.1/servers/7a5dd9d2-a5d0-49a4-bc75-727de7076c66" status: 200 len: 1359 microversion: 2.1 time: 0.179870 Mar 05 03:00:14.069170 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 414/811] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 03:00:13 2022] GET /compute/v2.1/servers/7a5dd9d2-a5d0-49a4-bc75-727de7076c66 => generated 1359 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 03:00:15.066795 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-44b030a4-cec4-4335-9abc-9dda87850be9 tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1064872546", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1345238013", "security_groups": [{"name": "tempest-secgroup-smoke-1280001705"}], "block_device_mapping_v2": [{"uuid": "10192887-10a3-4ccc-a958-b222816126a9", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "212982fd-ee74-4572-8056-95fa37c5661e"}]}} {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 03:00:15.086574 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-d9dbf944-44c6-4bd3-8a65-16ccfe3eeaa2 tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 03:00:15.087180 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-d9dbf944-44c6-4bd3-8a65-16ccfe3eeaa2 tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] [instance: 7a5dd9d2-a5d0-49a4-bc75-727de7076c66] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 03:00:15.093652 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-d9dbf944-44c6-4bd3-8a65-16ccfe3eeaa2 tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 03:00:15.094222 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-d9dbf944-44c6-4bd3-8a65-16ccfe3eeaa2 tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 03:00:15.095005 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-d9dbf944-44c6-4bd3-8a65-16ccfe3eeaa2 tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 03:00:15.095629 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-d9dbf944-44c6-4bd3-8a65-16ccfe3eeaa2 tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 03:00:15.491034 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.network.neutron [None req-44b030a4-cec4-4335-9abc-9dda87850be9 tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] validate_networks() for [('212982fd-ee74-4572-8056-95fa37c5661e', None, None, None, None, None)] {{(pid=123546) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 05 03:00:15.628933 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-d9dbf944-44c6-4bd3-8a65-16ccfe3eeaa2 tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18be544fa93d45b5866e5457c92cbeed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afdf34f696b743d1885e8c9895a1d4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 03:00:15.636275 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-d9dbf944-44c6-4bd3-8a65-16ccfe3eeaa2 tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] 10.222.0.26 "GET /compute/v2.1/servers/7a5dd9d2-a5d0-49a4-bc75-727de7076c66" status: 200 len: 1359 microversion: 2.1 time: 0.553496 Mar 05 03:00:15.636860 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 415/812] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 03:00:15 2022] GET /compute/v2.1/servers/7a5dd9d2-a5d0-49a4-bc75-727de7076c66 => generated 1359 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 03:00:16.095512 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.virt.hardware [None req-44b030a4-cec4-4335-9abc-9dda87850be9 tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Flavor limits 0:0:0 {{(pid=123546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 05 03:00:16.096001 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.virt.hardware [None req-44b030a4-cec4-4335-9abc-9dda87850be9 tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Image limits 0:0:0 {{(pid=123546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 05 03:00:16.096388 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.virt.hardware [None req-44b030a4-cec4-4335-9abc-9dda87850be9 tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Flavor pref 0:0:0 {{(pid=123546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 05 03:00:16.096819 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.virt.hardware [None req-44b030a4-cec4-4335-9abc-9dda87850be9 tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Image pref 0:0:0 {{(pid=123546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 05 03:00:16.097472 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.virt.hardware [None req-44b030a4-cec4-4335-9abc-9dda87850be9 tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 05 03:00:16.106260 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-44b030a4-cec4-4335-9abc-9dda87850be9 tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 03:00:16.106704 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-44b030a4-cec4-4335-9abc-9dda87850be9 tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 03:00:16.107501 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-44b030a4-cec4-4335-9abc-9dda87850be9 tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 03:00:16.107930 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-44b030a4-cec4-4335-9abc-9dda87850be9 tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 03:00:16.125338 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.quota [None req-44b030a4-cec4-4335-9abc-9dda87850be9 tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Getting quotas for project 71e08e745e374d92a13f0a03ad69b496. Resources: {'ram', 'cores', 'instances'} {{(pid=123546) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 03:00:16.129523 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.quota [None req-44b030a4-cec4-4335-9abc-9dda87850be9 tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Getting quotas for user d53fb7a6cf8b4d47a871ee2a1a24d21f and project 71e08e745e374d92a13f0a03ad69b496. Resources: {'ram', 'cores', 'instances'} {{(pid=123546) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 03:00:16.188057 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-44b030a4-cec4-4335-9abc-9dda87850be9 tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Going to run 1 instances... {{(pid=123546) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 05 03:00:16.190245 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-44b030a4-cec4-4335-9abc-9dda87850be9 tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] [instance: 431b9c6e-48ce-4fa6-a266-cb5b04556cf1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='10192887-10a3-4ccc-a958-b222816126a9',volume_size=None,volume_type=None)] {{(pid=123546) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 05 03:00:16.318849 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-44b030a4-cec4-4335-9abc-9dda87850be9 tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.256138 Mar 05 03:00:16.319493 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 398/813] 10.222.0.26 () {60 vars in 1146 bytes} [Sat Mar 5 03:00:15 2022] POST /compute/v2.1/servers => generated 406 bytes in 1258 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 05 03:00:16.329187 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-6f2943b7-5370-47f6-a924-297eb26a589c tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 03:00:16.329945 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-6f2943b7-5370-47f6-a924-297eb26a589c tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] [instance: 431b9c6e-48ce-4fa6-a266-cb5b04556cf1] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 03:00:16.382597 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-6f2943b7-5370-47f6-a924-297eb26a589c tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53fb7a6cf8b4d47a871ee2a1a24d21f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e08e745e374d92a13f0a03ad69b496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 03:00:16.389083 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-6f2943b7-5370-47f6-a924-297eb26a589c tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] 10.222.0.26 "GET /compute/v2.1/servers/431b9c6e-48ce-4fa6-a266-cb5b04556cf1" status: 200 len: 1095 microversion: 2.1 time: 0.063651 Mar 05 03:00:16.389690 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 416/814] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 03:00:16 2022] GET /compute/v2.1/servers/431b9c6e-48ce-4fa6-a266-cb5b04556cf1 => generated 1095 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 03:00:16.654282 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-779095b0-a6e1-4a2f-9e3f-6176d3a8fe14 tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 03:00:16.655020 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-779095b0-a6e1-4a2f-9e3f-6176d3a8fe14 tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] [instance: 7a5dd9d2-a5d0-49a4-bc75-727de7076c66] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 03:00:16.663755 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-779095b0-a6e1-4a2f-9e3f-6176d3a8fe14 tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 03:00:16.664291 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-779095b0-a6e1-4a2f-9e3f-6176d3a8fe14 tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 03:00:16.665148 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-779095b0-a6e1-4a2f-9e3f-6176d3a8fe14 tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 03:00:16.665590 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-779095b0-a6e1-4a2f-9e3f-6176d3a8fe14 tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 03:00:16.819582 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-779095b0-a6e1-4a2f-9e3f-6176d3a8fe14 tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18be544fa93d45b5866e5457c92cbeed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afdf34f696b743d1885e8c9895a1d4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 03:00:16.828400 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-779095b0-a6e1-4a2f-9e3f-6176d3a8fe14 tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] 10.222.0.26 "GET /compute/v2.1/servers/7a5dd9d2-a5d0-49a4-bc75-727de7076c66" status: 200 len: 1359 microversion: 2.1 time: 0.177996 Mar 05 03:00:16.829053 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 399/815] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 03:00:16 2022] GET /compute/v2.1/servers/7a5dd9d2-a5d0-49a4-bc75-727de7076c66 => generated 1359 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 03:00:16.912291 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [req-acdf8eec-5065-4025-aa44-6ad932cd6655 req-a551d134-0d17-4dc8-958d-8d0062f28b9d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a5dd9d2-a5d0-49a4-bc75-727de7076c66", "name": "network-vif-plugged", "status": "completed", "tag": "789f23b9-7562-4e04-91c4-acdf502fe56a"}]} {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 03:00:16.922770 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [req-acdf8eec-5065-4025-aa44-6ad932cd6655 req-a551d134-0d17-4dc8-958d-8d0062f28b9d service nova] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 03:00:16.930854 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [req-acdf8eec-5065-4025-aa44-6ad932cd6655 req-a551d134-0d17-4dc8-958d-8d0062f28b9d service nova] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 03:00:16.944070 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.compute.server_external_events [req-acdf8eec-5065-4025-aa44-6ad932cd6655 req-a551d134-0d17-4dc8-958d-8d0062f28b9d service nova] Creating event network-vif-plugged:789f23b9-7562-4e04-91c4-acdf502fe56a for instance 7a5dd9d2-a5d0-49a4-bc75-727de7076c66 on hv-cinder-82725 Mar 05 03:00:16.949120 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [req-acdf8eec-5065-4025-aa44-6ad932cd6655 req-a551d134-0d17-4dc8-958d-8d0062f28b9d service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040461 Mar 05 03:00:16.950002 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 417/816] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Mar 5 03:00:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 05 03:00:17.407410 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-b19cd271-ed2f-4ebd-86f5-519760a8becd tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 03:00:17.408019 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-b19cd271-ed2f-4ebd-86f5-519760a8becd tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] [instance: 431b9c6e-48ce-4fa6-a266-cb5b04556cf1] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 03:00:17.413807 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-b19cd271-ed2f-4ebd-86f5-519760a8becd tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 03:00:17.414230 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-b19cd271-ed2f-4ebd-86f5-519760a8becd tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 03:00:17.414995 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-b19cd271-ed2f-4ebd-86f5-519760a8becd tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 03:00:17.415426 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-b19cd271-ed2f-4ebd-86f5-519760a8becd tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 03:00:17.503639 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-b19cd271-ed2f-4ebd-86f5-519760a8becd tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53fb7a6cf8b4d47a871ee2a1a24d21f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e08e745e374d92a13f0a03ad69b496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 03:00:17.512923 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-b19cd271-ed2f-4ebd-86f5-519760a8becd tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] 10.222.0.26 "GET /compute/v2.1/servers/431b9c6e-48ce-4fa6-a266-cb5b04556cf1" status: 200 len: 1193 microversion: 2.1 time: 0.109809 Mar 05 03:00:17.513711 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 400/817] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 03:00:17 2022] GET /compute/v2.1/servers/431b9c6e-48ce-4fa6-a266-cb5b04556cf1 => generated 1193 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 03:00:17.846264 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-261b70df-6b74-4057-8ba3-892bcc45e540 tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 03:00:17.846973 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-261b70df-6b74-4057-8ba3-892bcc45e540 tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] [instance: 7a5dd9d2-a5d0-49a4-bc75-727de7076c66] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 03:00:17.853237 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-261b70df-6b74-4057-8ba3-892bcc45e540 tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 03:00:17.853690 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-261b70df-6b74-4057-8ba3-892bcc45e540 tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 03:00:17.854496 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-261b70df-6b74-4057-8ba3-892bcc45e540 tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 03:00:17.854939 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-261b70df-6b74-4057-8ba3-892bcc45e540 tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 03:00:18.102456 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-261b70df-6b74-4057-8ba3-892bcc45e540 tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18be544fa93d45b5866e5457c92cbeed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afdf34f696b743d1885e8c9895a1d4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 03:00:18.111093 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-261b70df-6b74-4057-8ba3-892bcc45e540 tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] 10.222.0.26 "GET /compute/v2.1/servers/7a5dd9d2-a5d0-49a4-bc75-727de7076c66" status: 200 len: 1359 microversion: 2.1 time: 0.270085 Mar 05 03:00:18.111753 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 418/818] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 03:00:17 2022] GET /compute/v2.1/servers/7a5dd9d2-a5d0-49a4-bc75-727de7076c66 => generated 1359 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 03:00:18.529836 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-fc194e82-ccf3-4f91-88bf-e1e705582588 tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 03:00:18.530538 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-fc194e82-ccf3-4f91-88bf-e1e705582588 tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] [instance: 431b9c6e-48ce-4fa6-a266-cb5b04556cf1] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 03:00:18.536948 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-fc194e82-ccf3-4f91-88bf-e1e705582588 tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 03:00:18.537392 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-fc194e82-ccf3-4f91-88bf-e1e705582588 tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 03:00:18.538195 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-fc194e82-ccf3-4f91-88bf-e1e705582588 tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 03:00:18.538626 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-fc194e82-ccf3-4f91-88bf-e1e705582588 tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 03:00:18.766423 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-fc194e82-ccf3-4f91-88bf-e1e705582588 tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53fb7a6cf8b4d47a871ee2a1a24d21f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e08e745e374d92a13f0a03ad69b496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 03:00:18.776635 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-fc194e82-ccf3-4f91-88bf-e1e705582588 tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] 10.222.0.26 "GET /compute/v2.1/servers/431b9c6e-48ce-4fa6-a266-cb5b04556cf1" status: 200 len: 1267 microversion: 2.1 time: 0.250626 Mar 05 03:00:18.778190 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 401/819] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 03:00:18 2022] GET /compute/v2.1/servers/431b9c6e-48ce-4fa6-a266-cb5b04556cf1 => generated 1267 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 03:00:18.932249 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-9e07cdec-351c-43cd-811a-ef0bd5013338 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 03:00:18.932726 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-9e07cdec-351c-43cd-811a-ef0bd5013338 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] [instance: b38da944-08fc-4ef6-bee2-ede7b8829ee8] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 03:00:18.940941 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-9e07cdec-351c-43cd-811a-ef0bd5013338 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 03:00:18.941673 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-9e07cdec-351c-43cd-811a-ef0bd5013338 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 03:00:18.942831 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-9e07cdec-351c-43cd-811a-ef0bd5013338 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 03:00:18.943428 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-9e07cdec-351c-43cd-811a-ef0bd5013338 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 03:00:19.023001 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [req-0435e5b2-830b-4e00-b4dc-e8b986b103c5 req-86f51873-6540-4685-aec7-815c24aadcb4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "431b9c6e-48ce-4fa6-a266-cb5b04556cf1", "tag": "bc546a7e-8244-4bb2-a21a-ee3767b86ae3"}]} {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 03:00:19.032455 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [req-0435e5b2-830b-4e00-b4dc-e8b986b103c5 req-86f51873-6540-4685-aec7-815c24aadcb4 service nova] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 03:00:19.033146 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [req-0435e5b2-830b-4e00-b4dc-e8b986b103c5 req-86f51873-6540-4685-aec7-815c24aadcb4 service nova] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 03:00:19.035009 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.objects.instance [None req-9e07cdec-351c-43cd-811a-ef0bd5013338 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lazy-loading 'services' on Instance uuid b38da944-08fc-4ef6-bee2-ede7b8829ee8 {{(pid=123545) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 05 03:00:19.057681 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.compute.server_external_events [req-0435e5b2-830b-4e00-b4dc-e8b986b103c5 req-86f51873-6540-4685-aec7-815c24aadcb4 service nova] Creating event network-changed:bc546a7e-8244-4bb2-a21a-ee3767b86ae3 for instance 431b9c6e-48ce-4fa6-a266-cb5b04556cf1 on hv-cinder-82725 Mar 05 03:00:19.064306 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [req-0435e5b2-830b-4e00-b4dc-e8b986b103c5 req-86f51873-6540-4685-aec7-815c24aadcb4 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044990 Mar 05 03:00:19.065608 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 402/820] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Mar 5 03:00:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 03:00:19.127714 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-9e07cdec-351c-43cd-811a-ef0bd5013338 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] 10.222.0.26 "DELETE /compute/v2.1/servers/b38da944-08fc-4ef6-bee2-ede7b8829ee8/os-volume_attachments/510e860b-f52c-45ac-a3d6-2f26b5a26a77" status: 202 len: 0 microversion: 2.1 time: 0.201356 Mar 05 03:00:19.128397 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 419/821] 10.222.0.26 () {58 vars in 1415 bytes} [Sat Mar 5 03:00:18 2022] DELETE /compute/v2.1/servers/b38da944-08fc-4ef6-bee2-ede7b8829ee8/os-volume_attachments/510e860b-f52c-45ac-a3d6-2f26b5a26a77 => generated 0 bytes in 203 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 05 03:00:19.130339 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-0d3582ea-52a4-45d6-b7cc-3af1bc231957 tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 03:00:19.131352 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-0d3582ea-52a4-45d6-b7cc-3af1bc231957 tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] [instance: 7a5dd9d2-a5d0-49a4-bc75-727de7076c66] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 03:00:19.136958 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-3b4800c9-2319-410f-9a17-02e71e82fe04 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 03:00:19.138241 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-3b4800c9-2319-410f-9a17-02e71e82fe04 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] [instance: b38da944-08fc-4ef6-bee2-ede7b8829ee8] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 03:00:19.139236 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-0d3582ea-52a4-45d6-b7cc-3af1bc231957 tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 03:00:19.140252 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-0d3582ea-52a4-45d6-b7cc-3af1bc231957 tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 03:00:19.141911 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-0d3582ea-52a4-45d6-b7cc-3af1bc231957 tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 03:00:19.142448 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-0d3582ea-52a4-45d6-b7cc-3af1bc231957 tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 03:00:19.153338 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-3b4800c9-2319-410f-9a17-02e71e82fe04 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 03:00:19.157295 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-3b4800c9-2319-410f-9a17-02e71e82fe04 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 03:00:19.158390 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-3b4800c9-2319-410f-9a17-02e71e82fe04 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 03:00:19.159006 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-3b4800c9-2319-410f-9a17-02e71e82fe04 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 03:00:19.197818 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-3b4800c9-2319-410f-9a17-02e71e82fe04 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] 10.222.0.26 "GET /compute/v2.1/servers/b38da944-08fc-4ef6-bee2-ede7b8829ee8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.064869 Mar 05 03:00:19.198720 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 420/822] 10.222.0.26 () {58 vars in 1301 bytes} [Sat Mar 5 03:00:19 2022] GET /compute/v2.1/servers/b38da944-08fc-4ef6-bee2-ede7b8829ee8/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 05 03:00:19.351717 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-0d3582ea-52a4-45d6-b7cc-3af1bc231957 tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18be544fa93d45b5866e5457c92cbeed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afdf34f696b743d1885e8c9895a1d4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 03:00:19.359520 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-0d3582ea-52a4-45d6-b7cc-3af1bc231957 tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] 10.222.0.26 "GET /compute/v2.1/servers/7a5dd9d2-a5d0-49a4-bc75-727de7076c66" status: 200 len: 1549 microversion: 2.1 time: 0.234475 Mar 05 03:00:19.360094 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 403/823] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 03:00:19 2022] GET /compute/v2.1/servers/7a5dd9d2-a5d0-49a4-bc75-727de7076c66 => generated 1549 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 03:00:19.375553 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-0acb0d3a-b2f0-4239-936f-e22a57449d5f tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 03:00:19.376277 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-0acb0d3a-b2f0-4239-936f-e22a57449d5f tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] [instance: 7a5dd9d2-a5d0-49a4-bc75-727de7076c66] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 03:00:19.382011 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-0acb0d3a-b2f0-4239-936f-e22a57449d5f tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 03:00:19.382488 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-0acb0d3a-b2f0-4239-936f-e22a57449d5f tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 03:00:19.383250 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-0acb0d3a-b2f0-4239-936f-e22a57449d5f tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 03:00:19.383678 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-0acb0d3a-b2f0-4239-936f-e22a57449d5f tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 03:00:19.599575 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-0acb0d3a-b2f0-4239-936f-e22a57449d5f tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18be544fa93d45b5866e5457c92cbeed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afdf34f696b743d1885e8c9895a1d4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 03:00:19.607804 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-0acb0d3a-b2f0-4239-936f-e22a57449d5f tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] 10.222.0.26 "GET /compute/v2.1/servers/7a5dd9d2-a5d0-49a4-bc75-727de7076c66" status: 200 len: 1549 microversion: 2.1 time: 0.236227 Mar 05 03:00:19.619005 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 421/824] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 03:00:19 2022] GET /compute/v2.1/servers/7a5dd9d2-a5d0-49a4-bc75-727de7076c66 => generated 1549 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 03:00:19.625867 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-3d15c66c-7243-42d6-af36-ea5d04e0e6c7 tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 03:00:19.630399 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-3d15c66c-7243-42d6-af36-ea5d04e0e6c7 tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '18be544fa93d45b5866e5457c92cbeed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afdf34f696b743d1885e8c9895a1d4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 03:00:19.631234 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-3d15c66c-7243-42d6-af36-ea5d04e0e6c7 tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] Searching by: {'deleted': False, 'project_id': 'afdf34f696b743d1885e8c9895a1d4b0'} {{(pid=123546) get_all /opt/stack/nova/nova/compute/api.py:2960}} Mar 05 03:00:19.640193 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-3d15c66c-7243-42d6-af36-ea5d04e0e6c7 tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 03:00:19.640708 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-3d15c66c-7243-42d6-af36-ea5d04e0e6c7 tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 03:00:19.641517 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-3d15c66c-7243-42d6-af36-ea5d04e0e6c7 tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 03:00:19.642036 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-3d15c66c-7243-42d6-af36-ea5d04e0e6c7 tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 03:00:19.738665 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.multi_cell_list [None req-3d15c66c-7243-42d6-af36-ea5d04e0e6c7 tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=123546) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Mar 05 03:00:19.794571 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-ae73ca8d-b4be-4165-990d-926f5ae14a0e tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 03:00:19.795491 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-ae73ca8d-b4be-4165-990d-926f5ae14a0e tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] [instance: 431b9c6e-48ce-4fa6-a266-cb5b04556cf1] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 03:00:19.802499 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-ae73ca8d-b4be-4165-990d-926f5ae14a0e tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 03:00:19.803263 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-ae73ca8d-b4be-4165-990d-926f5ae14a0e tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 03:00:19.804137 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-ae73ca8d-b4be-4165-990d-926f5ae14a0e tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 03:00:19.804737 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-ae73ca8d-b4be-4165-990d-926f5ae14a0e tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 03:00:20.011064 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-3d15c66c-7243-42d6-af36-ea5d04e0e6c7 tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] 10.222.0.26 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.389849 Mar 05 03:00:20.011662 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 404/825] 10.222.0.26 () {58 vars in 1124 bytes} [Sat Mar 5 03:00:19 2022] GET /compute/v2.1/servers => generated 343 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 03:00:20.022126 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-d0e9327b-2bc4-4902-8acb-a090a497f758 tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 03:00:20.022736 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-d0e9327b-2bc4-4902-8acb-a090a497f758 tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] [instance: 7a5dd9d2-a5d0-49a4-bc75-727de7076c66] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 03:00:20.028586 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-d0e9327b-2bc4-4902-8acb-a090a497f758 tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 03:00:20.029038 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-d0e9327b-2bc4-4902-8acb-a090a497f758 tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 03:00:20.029810 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-d0e9327b-2bc4-4902-8acb-a090a497f758 tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 03:00:20.030320 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-d0e9327b-2bc4-4902-8acb-a090a497f758 tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 03:00:20.045097 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-ae73ca8d-b4be-4165-990d-926f5ae14a0e tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53fb7a6cf8b4d47a871ee2a1a24d21f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e08e745e374d92a13f0a03ad69b496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 03:00:20.053144 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-ae73ca8d-b4be-4165-990d-926f5ae14a0e tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] 10.222.0.26 "GET /compute/v2.1/servers/431b9c6e-48ce-4fa6-a266-cb5b04556cf1" status: 200 len: 1267 microversion: 2.1 time: 0.262456 Mar 05 03:00:20.053812 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 422/826] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 03:00:19 2022] GET /compute/v2.1/servers/431b9c6e-48ce-4fa6-a266-cb5b04556cf1 => generated 1267 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 03:00:20.208867 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-1201472b-4ff9-44d7-9d9d-734cf33813b2 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 03:00:20.209765 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-1201472b-4ff9-44d7-9d9d-734cf33813b2 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] [instance: b38da944-08fc-4ef6-bee2-ede7b8829ee8] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 03:00:20.215667 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-1201472b-4ff9-44d7-9d9d-734cf33813b2 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 03:00:20.216116 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-1201472b-4ff9-44d7-9d9d-734cf33813b2 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 03:00:20.216874 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-1201472b-4ff9-44d7-9d9d-734cf33813b2 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 03:00:20.217325 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-1201472b-4ff9-44d7-9d9d-734cf33813b2 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 03:00:20.245385 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-1201472b-4ff9-44d7-9d9d-734cf33813b2 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] 10.222.0.26 "GET /compute/v2.1/servers/b38da944-08fc-4ef6-bee2-ede7b8829ee8/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.040440 Mar 05 03:00:20.245961 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 423/827] 10.222.0.26 () {58 vars in 1301 bytes} [Sat Mar 5 03:00:20 2022] GET /compute/v2.1/servers/b38da944-08fc-4ef6-bee2-ede7b8829ee8/os-volume_attachments => generated 25 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Mar 05 03:00:20.250647 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-d0e9327b-2bc4-4902-8acb-a090a497f758 tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18be544fa93d45b5866e5457c92cbeed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afdf34f696b743d1885e8c9895a1d4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 03:00:20.258940 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-d0e9327b-2bc4-4902-8acb-a090a497f758 tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] 10.222.0.26 "GET /compute/v2.1/servers/7a5dd9d2-a5d0-49a4-bc75-727de7076c66" status: 200 len: 1549 microversion: 2.1 time: 0.240420 Mar 05 03:00:20.259582 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 405/828] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 03:00:20 2022] GET /compute/v2.1/servers/7a5dd9d2-a5d0-49a4-bc75-727de7076c66 => generated 1549 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 03:00:20.307431 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-c1413b86-f61f-48fe-b793-13bef0a15ca3 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 03:00:20.307933 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-c1413b86-f61f-48fe-b793-13bef0a15ca3 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] [instance: b38da944-08fc-4ef6-bee2-ede7b8829ee8] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 03:00:20.314844 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-c1413b86-f61f-48fe-b793-13bef0a15ca3 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 03:00:20.315306 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-c1413b86-f61f-48fe-b793-13bef0a15ca3 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 03:00:20.316116 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-c1413b86-f61f-48fe-b793-13bef0a15ca3 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 03:00:20.316557 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-c1413b86-f61f-48fe-b793-13bef0a15ca3 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 03:00:20.339910 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-c1413b86-f61f-48fe-b793-13bef0a15ca3 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] [instance: b38da944-08fc-4ef6-bee2-ede7b8829ee8] Going to try to terminate instance {{(pid=123545) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 05 03:00:20.415924 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-c1413b86-f61f-48fe-b793-13bef0a15ca3 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] 10.222.0.26 "DELETE /compute/v2.1/servers/b38da944-08fc-4ef6-bee2-ede7b8829ee8" status: 204 len: 0 microversion: 2.1 time: 0.112161 Mar 05 03:00:20.420243 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 424/829] 10.222.0.26 () {58 vars in 1238 bytes} [Sat Mar 5 03:00:20 2022] DELETE /compute/v2.1/servers/b38da944-08fc-4ef6-bee2-ede7b8829ee8 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 05 03:00:20.425790 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-efdeb558-ebcf-42bd-916f-62f77c396873 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 03:00:20.426545 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-efdeb558-ebcf-42bd-916f-62f77c396873 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] [instance: b38da944-08fc-4ef6-bee2-ede7b8829ee8] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 03:00:20.432191 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-efdeb558-ebcf-42bd-916f-62f77c396873 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 03:00:20.432640 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-efdeb558-ebcf-42bd-916f-62f77c396873 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 03:00:20.433409 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-efdeb558-ebcf-42bd-916f-62f77c396873 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 03:00:20.433867 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-efdeb558-ebcf-42bd-916f-62f77c396873 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 03:00:20.582777 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-efdeb558-ebcf-42bd-916f-62f77c396873 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af8fb7f45f4d4eb180ccaca3d52ed2dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dd2b27540c04b4c8741ce8c9a5e2b47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 03:00:20.590505 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-efdeb558-ebcf-42bd-916f-62f77c396873 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] 10.222.0.26 "GET /compute/v2.1/servers/b38da944-08fc-4ef6-bee2-ede7b8829ee8" status: 200 len: 1677 microversion: 2.1 time: 0.168522 Mar 05 03:00:20.591074 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 406/830] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 03:00:20 2022] GET /compute/v2.1/servers/b38da944-08fc-4ef6-bee2-ede7b8829ee8 => generated 1677 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 03:00:21.071215 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-f3f67ab3-6df3-4c88-8106-d0e79243eb3f tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 03:00:21.071923 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-f3f67ab3-6df3-4c88-8106-d0e79243eb3f tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] [instance: 431b9c6e-48ce-4fa6-a266-cb5b04556cf1] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 03:00:21.079021 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-f3f67ab3-6df3-4c88-8106-d0e79243eb3f tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 03:00:21.079467 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-f3f67ab3-6df3-4c88-8106-d0e79243eb3f tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 03:00:21.080226 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-f3f67ab3-6df3-4c88-8106-d0e79243eb3f tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 03:00:21.080660 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-f3f67ab3-6df3-4c88-8106-d0e79243eb3f tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 03:00:21.215905 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-f3f67ab3-6df3-4c88-8106-d0e79243eb3f tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53fb7a6cf8b4d47a871ee2a1a24d21f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e08e745e374d92a13f0a03ad69b496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 03:00:21.223396 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-f3f67ab3-6df3-4c88-8106-d0e79243eb3f tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] 10.222.0.26 "GET /compute/v2.1/servers/431b9c6e-48ce-4fa6-a266-cb5b04556cf1" status: 200 len: 1267 microversion: 2.1 time: 0.156417 Mar 05 03:00:21.223950 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 425/831] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 03:00:21 2022] GET /compute/v2.1/servers/431b9c6e-48ce-4fa6-a266-cb5b04556cf1 => generated 1267 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 03:00:21.608695 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-f84c48d6-f944-477f-ab03-65917129da80 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 03:00:21.609491 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-f84c48d6-f944-477f-ab03-65917129da80 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] [instance: b38da944-08fc-4ef6-bee2-ede7b8829ee8] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 03:00:21.616135 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-f84c48d6-f944-477f-ab03-65917129da80 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 03:00:21.616582 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-f84c48d6-f944-477f-ab03-65917129da80 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 03:00:21.617357 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-f84c48d6-f944-477f-ab03-65917129da80 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 03:00:21.617788 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-f84c48d6-f944-477f-ab03-65917129da80 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 03:00:21.759144 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-f84c48d6-f944-477f-ab03-65917129da80 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af8fb7f45f4d4eb180ccaca3d52ed2dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dd2b27540c04b4c8741ce8c9a5e2b47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 03:00:21.766658 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-f84c48d6-f944-477f-ab03-65917129da80 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] 10.222.0.26 "GET /compute/v2.1/servers/b38da944-08fc-4ef6-bee2-ede7b8829ee8" status: 200 len: 1677 microversion: 2.1 time: 0.162248 Mar 05 03:00:21.767295 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 407/832] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 03:00:21 2022] GET /compute/v2.1/servers/b38da944-08fc-4ef6-bee2-ede7b8829ee8 => generated 1677 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 03:00:21.772772 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-4fcdd913-3330-44d6-b107-ad80048f9c22 tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7a693733-62be-4289-aad8-e7b76be96c04"}} {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 03:00:21.774004 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-4fcdd913-3330-44d6-b107-ad80048f9c22 tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] [instance: 7a5dd9d2-a5d0-49a4-bc75-727de7076c66] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 03:00:21.779731 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-4fcdd913-3330-44d6-b107-ad80048f9c22 tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 03:00:21.780216 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-4fcdd913-3330-44d6-b107-ad80048f9c22 tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 03:00:21.781123 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-4fcdd913-3330-44d6-b107-ad80048f9c22 tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 03:00:21.781556 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-4fcdd913-3330-44d6-b107-ad80048f9c22 tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 03:00:22.016483 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-4fcdd913-3330-44d6-b107-ad80048f9c22 tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] 10.222.0.26 "POST /compute/v2.1/servers/7a5dd9d2-a5d0-49a4-bc75-727de7076c66/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.247400 Mar 05 03:00:22.017221 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 426/833] 10.222.0.26 () {60 vars in 1322 bytes} [Sat Mar 5 03:00:21 2022] POST /compute/v2.1/servers/7a5dd9d2-a5d0-49a4-bc75-727de7076c66/os-volume_attachments => generated 194 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 03:00:22.240332 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-53d27cc8-37a0-41ad-b7c1-a2ae59fc78b4 tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 03:00:22.240953 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-53d27cc8-37a0-41ad-b7c1-a2ae59fc78b4 tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] [instance: 431b9c6e-48ce-4fa6-a266-cb5b04556cf1] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 03:00:22.246758 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-53d27cc8-37a0-41ad-b7c1-a2ae59fc78b4 tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 03:00:22.247218 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-53d27cc8-37a0-41ad-b7c1-a2ae59fc78b4 tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 03:00:22.248204 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-53d27cc8-37a0-41ad-b7c1-a2ae59fc78b4 tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 03:00:22.248644 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-53d27cc8-37a0-41ad-b7c1-a2ae59fc78b4 tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 03:00:22.491732 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-53d27cc8-37a0-41ad-b7c1-a2ae59fc78b4 tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53fb7a6cf8b4d47a871ee2a1a24d21f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e08e745e374d92a13f0a03ad69b496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 03:00:22.500534 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-53d27cc8-37a0-41ad-b7c1-a2ae59fc78b4 tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] 10.222.0.26 "GET /compute/v2.1/servers/431b9c6e-48ce-4fa6-a266-cb5b04556cf1" status: 200 len: 1267 microversion: 2.1 time: 0.264201 Mar 05 03:00:22.501116 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 408/834] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 03:00:22 2022] GET /compute/v2.1/servers/431b9c6e-48ce-4fa6-a266-cb5b04556cf1 => generated 1267 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 03:00:22.784265 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-2114a47c-d76e-4892-b694-fb458f9d9d5c tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 03:00:22.784964 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-2114a47c-d76e-4892-b694-fb458f9d9d5c tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] [instance: b38da944-08fc-4ef6-bee2-ede7b8829ee8] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 03:00:22.790958 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-2114a47c-d76e-4892-b694-fb458f9d9d5c tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 03:00:22.791414 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-2114a47c-d76e-4892-b694-fb458f9d9d5c tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 03:00:22.792191 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-2114a47c-d76e-4892-b694-fb458f9d9d5c tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 03:00:22.792628 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-2114a47c-d76e-4892-b694-fb458f9d9d5c tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 03:00:22.865374 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [req-8b585017-16a2-4f3c-8644-f63b6aed1f55 req-b7126f1a-891f-4b69-ade3-4a64100c5e41 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b38da944-08fc-4ef6-bee2-ede7b8829ee8", "name": "network-vif-deleted", "tag": "fd5a18a0-9b74-45f1-95e7-b2a51aa4cca3"}]} {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 03:00:22.874640 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [req-8b585017-16a2-4f3c-8644-f63b6aed1f55 req-b7126f1a-891f-4b69-ade3-4a64100c5e41 service nova] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 03:00:22.875085 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [req-8b585017-16a2-4f3c-8644-f63b6aed1f55 req-b7126f1a-891f-4b69-ade3-4a64100c5e41 service nova] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 03:00:22.886976 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.compute.server_external_events [req-8b585017-16a2-4f3c-8644-f63b6aed1f55 req-b7126f1a-891f-4b69-ade3-4a64100c5e41 service nova] Creating event network-vif-deleted:fd5a18a0-9b74-45f1-95e7-b2a51aa4cca3 for instance b38da944-08fc-4ef6-bee2-ede7b8829ee8 on hv-cinder-82725 Mar 05 03:00:22.893102 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [req-8b585017-16a2-4f3c-8644-f63b6aed1f55 req-b7126f1a-891f-4b69-ade3-4a64100c5e41 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031362 Mar 05 03:00:22.894489 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 409/835] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Mar 5 03:00:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 05 03:00:22.896203 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-2114a47c-d76e-4892-b694-fb458f9d9d5c tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af8fb7f45f4d4eb180ccaca3d52ed2dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dd2b27540c04b4c8741ce8c9a5e2b47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 03:00:22.904787 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-2114a47c-d76e-4892-b694-fb458f9d9d5c tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] 10.222.0.26 "GET /compute/v2.1/servers/b38da944-08fc-4ef6-bee2-ede7b8829ee8" status: 200 len: 1610 microversion: 2.1 time: 0.125179 Mar 05 03:00:22.905639 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 427/836] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 03:00:22 2022] GET /compute/v2.1/servers/b38da944-08fc-4ef6-bee2-ede7b8829ee8 => generated 1610 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 03:00:23.517943 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-91604313-3cf9-46e0-90bc-ce73aed0803b tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 03:00:23.518599 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-91604313-3cf9-46e0-90bc-ce73aed0803b tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] [instance: 431b9c6e-48ce-4fa6-a266-cb5b04556cf1] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 03:00:23.524983 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-91604313-3cf9-46e0-90bc-ce73aed0803b tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 03:00:23.525436 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-91604313-3cf9-46e0-90bc-ce73aed0803b tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 03:00:23.526241 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-91604313-3cf9-46e0-90bc-ce73aed0803b tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 03:00:23.526679 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-91604313-3cf9-46e0-90bc-ce73aed0803b tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 03:00:23.665697 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-91604313-3cf9-46e0-90bc-ce73aed0803b tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53fb7a6cf8b4d47a871ee2a1a24d21f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e08e745e374d92a13f0a03ad69b496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 03:00:23.675670 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-91604313-3cf9-46e0-90bc-ce73aed0803b tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] 10.222.0.26 "GET /compute/v2.1/servers/431b9c6e-48ce-4fa6-a266-cb5b04556cf1" status: 200 len: 1267 microversion: 2.1 time: 0.162518 Mar 05 03:00:23.684786 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 410/837] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 03:00:23 2022] GET /compute/v2.1/servers/431b9c6e-48ce-4fa6-a266-cb5b04556cf1 => generated 1267 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 03:00:23.922287 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-2b6ff732-6013-412e-8434-e15db855a9e8 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 03:00:23.922911 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-2b6ff732-6013-412e-8434-e15db855a9e8 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] [instance: b38da944-08fc-4ef6-bee2-ede7b8829ee8] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 03:00:23.929327 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-2b6ff732-6013-412e-8434-e15db855a9e8 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 03:00:23.929768 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-2b6ff732-6013-412e-8434-e15db855a9e8 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 03:00:23.930573 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-2b6ff732-6013-412e-8434-e15db855a9e8 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 03:00:23.931016 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-2b6ff732-6013-412e-8434-e15db855a9e8 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 03:00:23.943953 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.wsgi [None req-2b6ff732-6013-412e-8434-e15db855a9e8 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] HTTP exception thrown: Instance b38da944-08fc-4ef6-bee2-ede7b8829ee8 could not be found. Mar 05 03:00:23.944541 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-2b6ff732-6013-412e-8434-e15db855a9e8 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Returning 404 to user: Instance b38da944-08fc-4ef6-bee2-ede7b8829ee8 could not be found. {{(pid=123545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 03:00:23.945368 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-2b6ff732-6013-412e-8434-e15db855a9e8 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] 10.222.0.26 "GET /compute/v2.1/servers/b38da944-08fc-4ef6-bee2-ede7b8829ee8" status: 404 len: 111 microversion: 2.1 time: 0.027354 Mar 05 03:00:23.945908 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 428/838] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 03:00:23 2022] GET /compute/v2.1/servers/b38da944-08fc-4ef6-bee2-ede7b8829ee8 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 05 03:00:23.956328 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-6daea13d-6f77-415f-a3d5-87c73a1c4283 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Calling method '.version_select at 0x7f3f61cb3ee0>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 03:00:23.974160 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-6daea13d-6f77-415f-a3d5-87c73a1c4283 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-479854559" status: 202 len: 0 microversion: 2.1 time: 0.023708 Mar 05 03:00:23.974740 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 411/839] 10.222.0.26 () {58 vars in 1217 bytes} [Sat Mar 5 03:00:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-479854559 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 05 03:00:24.692641 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-3c5c008c-92f5-478f-acf2-9f42e9ac584d tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 03:00:24.693254 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-3c5c008c-92f5-478f-acf2-9f42e9ac584d tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] [instance: 431b9c6e-48ce-4fa6-a266-cb5b04556cf1] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 03:00:24.699500 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-3c5c008c-92f5-478f-acf2-9f42e9ac584d tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 03:00:24.699955 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-3c5c008c-92f5-478f-acf2-9f42e9ac584d tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 03:00:24.700719 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-3c5c008c-92f5-478f-acf2-9f42e9ac584d tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 03:00:24.701324 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-3c5c008c-92f5-478f-acf2-9f42e9ac584d tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 03:00:24.901775 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-3c5c008c-92f5-478f-acf2-9f42e9ac584d tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53fb7a6cf8b4d47a871ee2a1a24d21f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e08e745e374d92a13f0a03ad69b496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 03:00:24.911612 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-3c5c008c-92f5-478f-acf2-9f42e9ac584d tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] 10.222.0.26 "GET /compute/v2.1/servers/431b9c6e-48ce-4fa6-a266-cb5b04556cf1" status: 200 len: 1267 microversion: 2.1 time: 0.222846 Mar 05 03:00:24.912420 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 429/840] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 03:00:24 2022] GET /compute/v2.1/servers/431b9c6e-48ce-4fa6-a266-cb5b04556cf1 => generated 1267 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 03:00:25.930210 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-84a2e122-753a-4a26-93ca-aa01a67407f7 tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 03:00:25.930749 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-84a2e122-753a-4a26-93ca-aa01a67407f7 tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] [instance: 431b9c6e-48ce-4fa6-a266-cb5b04556cf1] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 03:00:25.938162 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-84a2e122-753a-4a26-93ca-aa01a67407f7 tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 03:00:25.938620 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-84a2e122-753a-4a26-93ca-aa01a67407f7 tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 03:00:25.939393 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-84a2e122-753a-4a26-93ca-aa01a67407f7 tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 03:00:25.939834 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-84a2e122-753a-4a26-93ca-aa01a67407f7 tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 03:00:26.003984 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-a1450963-e71f-4eb9-901a-02b334b1e628 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 03:00:26.004528 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-a1450963-e71f-4eb9-901a-02b334b1e628 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] [instance: b38da944-08fc-4ef6-bee2-ede7b8829ee8] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 03:00:26.010632 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-a1450963-e71f-4eb9-901a-02b334b1e628 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 03:00:26.011076 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-a1450963-e71f-4eb9-901a-02b334b1e628 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 03:00:26.011889 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-a1450963-e71f-4eb9-901a-02b334b1e628 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 03:00:26.012320 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-a1450963-e71f-4eb9-901a-02b334b1e628 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 03:00:26.025251 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.wsgi [None req-a1450963-e71f-4eb9-901a-02b334b1e628 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] HTTP exception thrown: Instance b38da944-08fc-4ef6-bee2-ede7b8829ee8 could not be found. Mar 05 03:00:26.025833 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-a1450963-e71f-4eb9-901a-02b334b1e628 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Returning 404 to user: Instance b38da944-08fc-4ef6-bee2-ede7b8829ee8 could not be found. {{(pid=123545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 03:00:26.026703 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-a1450963-e71f-4eb9-901a-02b334b1e628 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] 10.222.0.26 "DELETE /compute/v2.1/servers/b38da944-08fc-4ef6-bee2-ede7b8829ee8" status: 404 len: 111 microversion: 2.1 time: 0.026565 Mar 05 03:00:26.027236 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 430/841] 10.222.0.26 () {58 vars in 1238 bytes} [Sat Mar 5 03:00:25 2022] DELETE /compute/v2.1/servers/b38da944-08fc-4ef6-bee2-ede7b8829ee8 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Mar 05 03:00:26.034905 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-934e3ec0-8deb-4673-88d5-b87c4fe03338 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 03:00:26.035502 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-934e3ec0-8deb-4673-88d5-b87c4fe03338 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] [instance: b38da944-08fc-4ef6-bee2-ede7b8829ee8] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 03:00:26.041162 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-934e3ec0-8deb-4673-88d5-b87c4fe03338 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 03:00:26.041608 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-934e3ec0-8deb-4673-88d5-b87c4fe03338 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 03:00:26.042396 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-934e3ec0-8deb-4673-88d5-b87c4fe03338 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 03:00:26.042825 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-934e3ec0-8deb-4673-88d5-b87c4fe03338 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 03:00:26.056274 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.wsgi [None req-934e3ec0-8deb-4673-88d5-b87c4fe03338 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] HTTP exception thrown: Instance b38da944-08fc-4ef6-bee2-ede7b8829ee8 could not be found. Mar 05 03:00:26.056847 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-934e3ec0-8deb-4673-88d5-b87c4fe03338 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Returning 404 to user: Instance b38da944-08fc-4ef6-bee2-ede7b8829ee8 could not be found. {{(pid=123545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 03:00:26.057649 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-934e3ec0-8deb-4673-88d5-b87c4fe03338 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] 10.222.0.26 "GET /compute/v2.1/servers/b38da944-08fc-4ef6-bee2-ede7b8829ee8" status: 404 len: 111 microversion: 2.1 time: 0.026322 Mar 05 03:00:26.058218 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 431/842] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 03:00:26 2022] GET /compute/v2.1/servers/b38da944-08fc-4ef6-bee2-ede7b8829ee8 => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Mar 05 03:00:26.076091 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-84a2e122-753a-4a26-93ca-aa01a67407f7 tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53fb7a6cf8b4d47a871ee2a1a24d21f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e08e745e374d92a13f0a03ad69b496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 03:00:26.083726 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-84a2e122-753a-4a26-93ca-aa01a67407f7 tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] 10.222.0.26 "GET /compute/v2.1/servers/431b9c6e-48ce-4fa6-a266-cb5b04556cf1" status: 200 len: 1267 microversion: 2.1 time: 0.157967 Mar 05 03:00:26.084434 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 412/843] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 03:00:25 2022] GET /compute/v2.1/servers/431b9c6e-48ce-4fa6-a266-cb5b04556cf1 => generated 1267 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 03:00:27.100594 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-77e2f31a-66ba-47c6-8135-15f165d72237 tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 03:00:27.101207 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-77e2f31a-66ba-47c6-8135-15f165d72237 tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] [instance: 431b9c6e-48ce-4fa6-a266-cb5b04556cf1] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 03:00:27.107860 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-77e2f31a-66ba-47c6-8135-15f165d72237 tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 03:00:27.108358 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-77e2f31a-66ba-47c6-8135-15f165d72237 tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 03:00:27.109125 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-77e2f31a-66ba-47c6-8135-15f165d72237 tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 03:00:27.109561 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-77e2f31a-66ba-47c6-8135-15f165d72237 tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 03:00:27.189012 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-f5ee3222-6d72-4fc9-a25c-023477401306 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 03:00:27.189518 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-f5ee3222-6d72-4fc9-a25c-023477401306 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] [instance: 939b0cc0-f089-45e5-b1d4-c1117de03050] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 03:00:27.196010 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-f5ee3222-6d72-4fc9-a25c-023477401306 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 03:00:27.196468 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-f5ee3222-6d72-4fc9-a25c-023477401306 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 03:00:27.197267 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-f5ee3222-6d72-4fc9-a25c-023477401306 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 03:00:27.197707 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-f5ee3222-6d72-4fc9-a25c-023477401306 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 03:00:27.212039 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.wsgi [None req-f5ee3222-6d72-4fc9-a25c-023477401306 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] HTTP exception thrown: Instance 939b0cc0-f089-45e5-b1d4-c1117de03050 could not be found. Mar 05 03:00:27.212637 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-f5ee3222-6d72-4fc9-a25c-023477401306 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Returning 404 to user: Instance 939b0cc0-f089-45e5-b1d4-c1117de03050 could not be found. {{(pid=123546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 03:00:27.213473 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-f5ee3222-6d72-4fc9-a25c-023477401306 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] 10.222.0.26 "DELETE /compute/v2.1/servers/939b0cc0-f089-45e5-b1d4-c1117de03050" status: 404 len: 111 microversion: 2.1 time: 0.029027 Mar 05 03:00:27.214056 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 413/844] 10.222.0.26 () {58 vars in 1238 bytes} [Sat Mar 5 03:00:27 2022] DELETE /compute/v2.1/servers/939b0cc0-f089-45e5-b1d4-c1117de03050 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Mar 05 03:00:27.221821 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-2eaa5af0-0790-4f91-9bbf-a2bcf1512d8a tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 03:00:27.222458 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-2eaa5af0-0790-4f91-9bbf-a2bcf1512d8a tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] [instance: 939b0cc0-f089-45e5-b1d4-c1117de03050] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 03:00:27.228448 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-2eaa5af0-0790-4f91-9bbf-a2bcf1512d8a tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 03:00:27.228903 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-2eaa5af0-0790-4f91-9bbf-a2bcf1512d8a tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 03:00:27.229675 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-2eaa5af0-0790-4f91-9bbf-a2bcf1512d8a tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 03:00:27.230142 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-2eaa5af0-0790-4f91-9bbf-a2bcf1512d8a tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 03:00:27.243659 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.wsgi [None req-2eaa5af0-0790-4f91-9bbf-a2bcf1512d8a tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] HTTP exception thrown: Instance 939b0cc0-f089-45e5-b1d4-c1117de03050 could not be found. Mar 05 03:00:27.244375 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-2eaa5af0-0790-4f91-9bbf-a2bcf1512d8a tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Returning 404 to user: Instance 939b0cc0-f089-45e5-b1d4-c1117de03050 could not be found. {{(pid=123546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 03:00:27.245212 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-2eaa5af0-0790-4f91-9bbf-a2bcf1512d8a tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] 10.222.0.26 "GET /compute/v2.1/servers/939b0cc0-f089-45e5-b1d4-c1117de03050" status: 404 len: 111 microversion: 2.1 time: 0.027214 Mar 05 03:00:27.245769 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 414/845] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 03:00:27 2022] GET /compute/v2.1/servers/939b0cc0-f089-45e5-b1d4-c1117de03050 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Mar 05 03:00:27.251969 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-77e2f31a-66ba-47c6-8135-15f165d72237 tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53fb7a6cf8b4d47a871ee2a1a24d21f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e08e745e374d92a13f0a03ad69b496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 03:00:27.254259 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-3d8108a2-fd08-4e8b-bc7f-05608f55b9b4 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 03:00:27.254756 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-3d8108a2-fd08-4e8b-bc7f-05608f55b9b4 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] [instance: cd7bf2d1-7563-4057-8f9b-b7e51d741a6c] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 03:00:27.260104 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-77e2f31a-66ba-47c6-8135-15f165d72237 tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] 10.222.0.26 "GET /compute/v2.1/servers/431b9c6e-48ce-4fa6-a266-cb5b04556cf1" status: 200 len: 1267 microversion: 2.1 time: 0.163320 Mar 05 03:00:27.260886 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 432/846] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 03:00:27 2022] GET /compute/v2.1/servers/431b9c6e-48ce-4fa6-a266-cb5b04556cf1 => generated 1267 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 03:00:27.261012 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-3d8108a2-fd08-4e8b-bc7f-05608f55b9b4 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 03:00:27.261279 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-3d8108a2-fd08-4e8b-bc7f-05608f55b9b4 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 03:00:27.262094 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-3d8108a2-fd08-4e8b-bc7f-05608f55b9b4 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 03:00:27.262524 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-3d8108a2-fd08-4e8b-bc7f-05608f55b9b4 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 03:00:27.276599 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.wsgi [None req-3d8108a2-fd08-4e8b-bc7f-05608f55b9b4 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] HTTP exception thrown: Instance cd7bf2d1-7563-4057-8f9b-b7e51d741a6c could not be found. Mar 05 03:00:27.277187 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-3d8108a2-fd08-4e8b-bc7f-05608f55b9b4 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Returning 404 to user: Instance cd7bf2d1-7563-4057-8f9b-b7e51d741a6c could not be found. {{(pid=123546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 03:00:27.278033 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-3d8108a2-fd08-4e8b-bc7f-05608f55b9b4 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] 10.222.0.26 "DELETE /compute/v2.1/servers/cd7bf2d1-7563-4057-8f9b-b7e51d741a6c" status: 404 len: 111 microversion: 2.1 time: 0.027488 Mar 05 03:00:27.278587 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 415/847] 10.222.0.26 () {58 vars in 1238 bytes} [Sat Mar 5 03:00:27 2022] DELETE /compute/v2.1/servers/cd7bf2d1-7563-4057-8f9b-b7e51d741a6c => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 05 03:00:27.287442 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-225ddc15-3bbd-44bf-b359-7b0ff565d3f0 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 03:00:27.288053 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-225ddc15-3bbd-44bf-b359-7b0ff565d3f0 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] [instance: cd7bf2d1-7563-4057-8f9b-b7e51d741a6c] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 03:00:27.293791 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-225ddc15-3bbd-44bf-b359-7b0ff565d3f0 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 03:00:27.294311 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-225ddc15-3bbd-44bf-b359-7b0ff565d3f0 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 03:00:27.295074 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-225ddc15-3bbd-44bf-b359-7b0ff565d3f0 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 03:00:27.295501 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-225ddc15-3bbd-44bf-b359-7b0ff565d3f0 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 03:00:27.308605 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.wsgi [None req-225ddc15-3bbd-44bf-b359-7b0ff565d3f0 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] HTTP exception thrown: Instance cd7bf2d1-7563-4057-8f9b-b7e51d741a6c could not be found. Mar 05 03:00:27.309180 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-225ddc15-3bbd-44bf-b359-7b0ff565d3f0 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Returning 404 to user: Instance cd7bf2d1-7563-4057-8f9b-b7e51d741a6c could not be found. {{(pid=123545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 03:00:27.310039 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-225ddc15-3bbd-44bf-b359-7b0ff565d3f0 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] 10.222.0.26 "GET /compute/v2.1/servers/cd7bf2d1-7563-4057-8f9b-b7e51d741a6c" status: 404 len: 111 microversion: 2.1 time: 0.026398 Mar 05 03:00:27.310546 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 433/848] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 03:00:27 2022] GET /compute/v2.1/servers/cd7bf2d1-7563-4057-8f9b-b7e51d741a6c => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 05 03:00:28.278005 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-caf9a71e-0ca2-4516-96fb-501c85da04ba tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 03:00:28.278652 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-caf9a71e-0ca2-4516-96fb-501c85da04ba tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] [instance: 431b9c6e-48ce-4fa6-a266-cb5b04556cf1] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 03:00:28.285418 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-caf9a71e-0ca2-4516-96fb-501c85da04ba tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 03:00:28.285874 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-caf9a71e-0ca2-4516-96fb-501c85da04ba tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 03:00:28.286673 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-caf9a71e-0ca2-4516-96fb-501c85da04ba tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 03:00:28.287120 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-caf9a71e-0ca2-4516-96fb-501c85da04ba tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 03:00:28.422722 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-caf9a71e-0ca2-4516-96fb-501c85da04ba tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53fb7a6cf8b4d47a871ee2a1a24d21f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e08e745e374d92a13f0a03ad69b496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 03:00:28.430286 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-caf9a71e-0ca2-4516-96fb-501c85da04ba tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] 10.222.0.26 "GET /compute/v2.1/servers/431b9c6e-48ce-4fa6-a266-cb5b04556cf1" status: 200 len: 1267 microversion: 2.1 time: 0.156170 Mar 05 03:00:28.430851 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 416/849] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 03:00:28 2022] GET /compute/v2.1/servers/431b9c6e-48ce-4fa6-a266-cb5b04556cf1 => generated 1267 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 03:00:28.451877 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-783e4cc3-e40a-4f1b-99a7-141d22a74793 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 03:00:28.452373 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-783e4cc3-e40a-4f1b-99a7-141d22a74793 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] [instance: ec6e78b4-5147-4f9b-84ce-c5d5ec0bd30d] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 03:00:28.459064 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-783e4cc3-e40a-4f1b-99a7-141d22a74793 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 03:00:28.459507 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-783e4cc3-e40a-4f1b-99a7-141d22a74793 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 03:00:28.460269 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-783e4cc3-e40a-4f1b-99a7-141d22a74793 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 03:00:28.460702 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-783e4cc3-e40a-4f1b-99a7-141d22a74793 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 03:00:28.475204 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.wsgi [None req-783e4cc3-e40a-4f1b-99a7-141d22a74793 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] HTTP exception thrown: Instance ec6e78b4-5147-4f9b-84ce-c5d5ec0bd30d could not be found. Mar 05 03:00:28.475787 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-783e4cc3-e40a-4f1b-99a7-141d22a74793 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Returning 404 to user: Instance ec6e78b4-5147-4f9b-84ce-c5d5ec0bd30d could not be found. {{(pid=123545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 03:00:28.476592 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-783e4cc3-e40a-4f1b-99a7-141d22a74793 tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] 10.222.0.26 "DELETE /compute/v2.1/servers/ec6e78b4-5147-4f9b-84ce-c5d5ec0bd30d" status: 404 len: 111 microversion: 2.1 time: 0.028502 Mar 05 03:00:28.477386 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 434/850] 10.222.0.26 () {58 vars in 1238 bytes} [Sat Mar 5 03:00:28 2022] DELETE /compute/v2.1/servers/ec6e78b4-5147-4f9b-84ce-c5d5ec0bd30d => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 05 03:00:28.485233 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-f78bc8e0-cc08-4a6c-a51e-d2d032952d8f tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 03:00:28.485853 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-f78bc8e0-cc08-4a6c-a51e-d2d032952d8f tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] [instance: ec6e78b4-5147-4f9b-84ce-c5d5ec0bd30d] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 03:00:28.491699 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-f78bc8e0-cc08-4a6c-a51e-d2d032952d8f tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 03:00:28.492231 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-f78bc8e0-cc08-4a6c-a51e-d2d032952d8f tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 03:00:28.492955 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-f78bc8e0-cc08-4a6c-a51e-d2d032952d8f tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 03:00:28.493394 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-f78bc8e0-cc08-4a6c-a51e-d2d032952d8f tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 03:00:28.506988 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.wsgi [None req-f78bc8e0-cc08-4a6c-a51e-d2d032952d8f tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] HTTP exception thrown: Instance ec6e78b4-5147-4f9b-84ce-c5d5ec0bd30d could not be found. Mar 05 03:00:28.507628 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-f78bc8e0-cc08-4a6c-a51e-d2d032952d8f tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] Returning 404 to user: Instance ec6e78b4-5147-4f9b-84ce-c5d5ec0bd30d could not be found. {{(pid=123546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 03:00:28.508375 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-f78bc8e0-cc08-4a6c-a51e-d2d032952d8f tempest-AttachVolumeNegativeTest-495083735 tempest-AttachVolumeNegativeTest-495083735-project] 10.222.0.26 "GET /compute/v2.1/servers/ec6e78b4-5147-4f9b-84ce-c5d5ec0bd30d" status: 404 len: 111 microversion: 2.1 time: 0.027045 Mar 05 03:00:28.508942 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 417/851] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 03:00:28 2022] GET /compute/v2.1/servers/ec6e78b4-5147-4f9b-84ce-c5d5ec0bd30d => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 05 03:00:28.523136 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-de69a7bc-f3f9-40ed-b612-79a7342e06f4 tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 03:00:28.523738 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-de69a7bc-f3f9-40ed-b612-79a7342e06f4 tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] [instance: 7a5dd9d2-a5d0-49a4-bc75-727de7076c66] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 03:00:28.529471 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-de69a7bc-f3f9-40ed-b612-79a7342e06f4 tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 03:00:28.529916 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-de69a7bc-f3f9-40ed-b612-79a7342e06f4 tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 03:00:28.530707 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-de69a7bc-f3f9-40ed-b612-79a7342e06f4 tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 03:00:28.531139 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-de69a7bc-f3f9-40ed-b612-79a7342e06f4 tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 03:00:28.775986 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-de69a7bc-f3f9-40ed-b612-79a7342e06f4 tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18be544fa93d45b5866e5457c92cbeed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afdf34f696b743d1885e8c9895a1d4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 03:00:28.786889 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-de69a7bc-f3f9-40ed-b612-79a7342e06f4 tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] 10.222.0.26 "GET /compute/v2.1/servers/7a5dd9d2-a5d0-49a4-bc75-727de7076c66" status: 200 len: 1595 microversion: 2.1 time: 0.267355 Mar 05 03:00:28.787620 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 435/852] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 03:00:28 2022] GET /compute/v2.1/servers/7a5dd9d2-a5d0-49a4-bc75-727de7076c66 => generated 1595 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 03:00:28.976776 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [req-16ebf5d8-44e9-493d-a0e3-716128540eab req-ef57c0f6-34eb-4c89-9208-c463c30e6843 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "431b9c6e-48ce-4fa6-a266-cb5b04556cf1", "name": "network-vif-plugged", "status": "completed", "tag": "bc546a7e-8244-4bb2-a21a-ee3767b86ae3"}]} {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 03:00:28.988810 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [req-16ebf5d8-44e9-493d-a0e3-716128540eab req-ef57c0f6-34eb-4c89-9208-c463c30e6843 service nova] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 03:00:28.989571 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [req-16ebf5d8-44e9-493d-a0e3-716128540eab req-ef57c0f6-34eb-4c89-9208-c463c30e6843 service nova] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 03:00:29.004082 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.compute.server_external_events [req-16ebf5d8-44e9-493d-a0e3-716128540eab req-ef57c0f6-34eb-4c89-9208-c463c30e6843 service nova] Creating event network-vif-plugged:bc546a7e-8244-4bb2-a21a-ee3767b86ae3 for instance 431b9c6e-48ce-4fa6-a266-cb5b04556cf1 on hv-cinder-82725 Mar 05 03:00:29.010287 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [req-16ebf5d8-44e9-493d-a0e3-716128540eab req-ef57c0f6-34eb-4c89-9208-c463c30e6843 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038260 Mar 05 03:00:29.011495 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 418/853] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Mar 5 03:00:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 03:00:29.447849 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-7dcf7906-cdff-4945-9f47-ebc55a4df205 tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 03:00:29.456375 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-7dcf7906-cdff-4945-9f47-ebc55a4df205 tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] [instance: 431b9c6e-48ce-4fa6-a266-cb5b04556cf1] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 03:00:29.464459 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-7dcf7906-cdff-4945-9f47-ebc55a4df205 tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 03:00:29.464907 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-7dcf7906-cdff-4945-9f47-ebc55a4df205 tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 03:00:29.465906 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-7dcf7906-cdff-4945-9f47-ebc55a4df205 tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 03:00:29.466361 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-7dcf7906-cdff-4945-9f47-ebc55a4df205 tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 03:00:29.676023 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-7dcf7906-cdff-4945-9f47-ebc55a4df205 tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53fb7a6cf8b4d47a871ee2a1a24d21f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e08e745e374d92a13f0a03ad69b496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 03:00:29.686052 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-7dcf7906-cdff-4945-9f47-ebc55a4df205 tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] 10.222.0.26 "GET /compute/v2.1/servers/431b9c6e-48ce-4fa6-a266-cb5b04556cf1" status: 200 len: 1267 microversion: 2.1 time: 0.242842 Mar 05 03:00:29.686720 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 436/854] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 03:00:29 2022] GET /compute/v2.1/servers/431b9c6e-48ce-4fa6-a266-cb5b04556cf1 => generated 1267 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 03:00:30.710759 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-03025dda-a8d2-44fd-8b4f-e423ef8e30ca tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 03:00:30.713552 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-03025dda-a8d2-44fd-8b4f-e423ef8e30ca tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] [instance: 431b9c6e-48ce-4fa6-a266-cb5b04556cf1] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 03:00:30.726461 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-03025dda-a8d2-44fd-8b4f-e423ef8e30ca tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 03:00:30.728387 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-03025dda-a8d2-44fd-8b4f-e423ef8e30ca tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 03:00:30.730128 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-03025dda-a8d2-44fd-8b4f-e423ef8e30ca tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 03:00:30.731625 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-03025dda-a8d2-44fd-8b4f-e423ef8e30ca tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 03:00:30.784916 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [req-3e6d79af-6286-4de6-9f0b-d89281c8ecc5 req-0d6b7e52-1855-42be-99d7-288331319f72 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7a5dd9d2-a5d0-49a4-bc75-727de7076c66", "tag": "789f23b9-7562-4e04-91c4-acdf502fe56a"}]} {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 03:00:30.802549 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [req-3e6d79af-6286-4de6-9f0b-d89281c8ecc5 req-0d6b7e52-1855-42be-99d7-288331319f72 service nova] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 03:00:30.806192 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [req-3e6d79af-6286-4de6-9f0b-d89281c8ecc5 req-0d6b7e52-1855-42be-99d7-288331319f72 service nova] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 03:00:30.831311 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.compute.server_external_events [req-3e6d79af-6286-4de6-9f0b-d89281c8ecc5 req-0d6b7e52-1855-42be-99d7-288331319f72 service nova] Creating event network-changed:789f23b9-7562-4e04-91c4-acdf502fe56a for instance 7a5dd9d2-a5d0-49a4-bc75-727de7076c66 on hv-cinder-82725 Mar 05 03:00:30.836617 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [req-3e6d79af-6286-4de6-9f0b-d89281c8ecc5 req-0d6b7e52-1855-42be-99d7-288331319f72 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060143 Mar 05 03:00:30.837898 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 437/855] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Mar 5 03:00:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 03:00:31.567477 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-03025dda-a8d2-44fd-8b4f-e423ef8e30ca tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53fb7a6cf8b4d47a871ee2a1a24d21f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e08e745e374d92a13f0a03ad69b496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 03:00:31.582353 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-03025dda-a8d2-44fd-8b4f-e423ef8e30ca tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] 10.222.0.26 "GET /compute/v2.1/servers/431b9c6e-48ce-4fa6-a266-cb5b04556cf1" status: 200 len: 1455 microversion: 2.1 time: 0.881549 Mar 05 03:00:31.583183 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 419/856] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 03:00:30 2022] GET /compute/v2.1/servers/431b9c6e-48ce-4fa6-a266-cb5b04556cf1 => generated 1455 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 03:00:31.600343 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-737be769-6008-4972-b4e4-df594993025e tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 03:00:31.601077 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-737be769-6008-4972-b4e4-df594993025e tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] [instance: 431b9c6e-48ce-4fa6-a266-cb5b04556cf1] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 03:00:31.607683 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-737be769-6008-4972-b4e4-df594993025e tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 03:00:31.608375 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-737be769-6008-4972-b4e4-df594993025e tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 03:00:31.610659 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-737be769-6008-4972-b4e4-df594993025e tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 03:00:31.611316 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-737be769-6008-4972-b4e4-df594993025e tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 03:00:32.036767 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-006cc805-0e22-47c7-983c-73125f8ff2af tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-290356933"}} {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 03:00:32.037393 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-006cc805-0e22-47c7-983c-73125f8ff2af tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] [instance: 7a5dd9d2-a5d0-49a4-bc75-727de7076c66] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 03:00:32.046504 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-006cc805-0e22-47c7-983c-73125f8ff2af tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 03:00:32.047945 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-006cc805-0e22-47c7-983c-73125f8ff2af tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 03:00:32.049297 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-006cc805-0e22-47c7-983c-73125f8ff2af tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 03:00:32.049924 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-006cc805-0e22-47c7-983c-73125f8ff2af tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 03:00:32.107380 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-737be769-6008-4972-b4e4-df594993025e tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53fb7a6cf8b4d47a871ee2a1a24d21f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e08e745e374d92a13f0a03ad69b496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 03:00:32.127979 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-737be769-6008-4972-b4e4-df594993025e tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] 10.222.0.26 "GET /compute/v2.1/servers/431b9c6e-48ce-4fa6-a266-cb5b04556cf1" status: 200 len: 1455 microversion: 2.1 time: 0.524371 Mar 05 03:00:32.138935 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 438/857] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 03:00:31 2022] GET /compute/v2.1/servers/431b9c6e-48ce-4fa6-a266-cb5b04556cf1 => generated 1455 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 03:00:32.345075 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.network.security_group_api [None req-006cc805-0e22-47c7-983c-73125f8ff2af tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] Adding security group b5840c17-46ee-4d84-909d-c6c53c7dcf63 to port 789f23b9-7562-4e04-91c4-acdf502fe56a Mar 05 03:00:33.007607 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-006cc805-0e22-47c7-983c-73125f8ff2af tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] 10.222.0.26 "POST /compute/v2.1/servers/7a5dd9d2-a5d0-49a4-bc75-727de7076c66/action" status: 202 len: 0 microversion: 2.1 time: 0.974044 Mar 05 03:00:33.010278 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 420/858] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Mar 5 03:00:32 2022] POST /compute/v2.1/servers/7a5dd9d2-a5d0-49a4-bc75-727de7076c66/action => generated 0 bytes in 979 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 05 03:00:33.019007 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-e733a635-0b04-4a4d-a4e1-223944eaf23d tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 03:00:33.019634 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-e733a635-0b04-4a4d-a4e1-223944eaf23d tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] [instance: 7a5dd9d2-a5d0-49a4-bc75-727de7076c66] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 03:00:33.025802 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-e733a635-0b04-4a4d-a4e1-223944eaf23d tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 03:00:33.035749 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [req-ec492289-5ffb-425c-b325-5d530ad2964f req-4e276771-abdc-4b17-a473-c9ab867e6cdc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7a5dd9d2-a5d0-49a4-bc75-727de7076c66", "tag": "789f23b9-7562-4e04-91c4-acdf502fe56a"}]} {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 03:00:33.044012 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [req-ec492289-5ffb-425c-b325-5d530ad2964f req-4e276771-abdc-4b17-a473-c9ab867e6cdc service nova] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 03:00:33.045174 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-e733a635-0b04-4a4d-a4e1-223944eaf23d tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 03:00:33.053021 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-e733a635-0b04-4a4d-a4e1-223944eaf23d tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 03:00:33.055926 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-e733a635-0b04-4a4d-a4e1-223944eaf23d tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 03:00:33.061266 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [req-ec492289-5ffb-425c-b325-5d530ad2964f req-4e276771-abdc-4b17-a473-c9ab867e6cdc service nova] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 03:00:33.093433 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.compute.server_external_events [req-ec492289-5ffb-425c-b325-5d530ad2964f req-4e276771-abdc-4b17-a473-c9ab867e6cdc service nova] Creating event network-changed:789f23b9-7562-4e04-91c4-acdf502fe56a for instance 7a5dd9d2-a5d0-49a4-bc75-727de7076c66 on hv-cinder-82725 Mar 05 03:00:33.103976 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [req-ec492289-5ffb-425c-b325-5d530ad2964f req-4e276771-abdc-4b17-a473-c9ab867e6cdc service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072617 Mar 05 03:00:33.104731 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 421/859] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Mar 5 03:00:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 05 03:00:33.515053 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-e733a635-0b04-4a4d-a4e1-223944eaf23d tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18be544fa93d45b5866e5457c92cbeed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afdf34f696b743d1885e8c9895a1d4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 03:00:33.527544 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-e733a635-0b04-4a4d-a4e1-223944eaf23d tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] 10.222.0.26 "GET /compute/v2.1/servers/7a5dd9d2-a5d0-49a4-bc75-727de7076c66" status: 200 len: 1759 microversion: 2.1 time: 0.512795 Mar 05 03:00:33.529130 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 439/860] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 03:00:33 2022] GET /compute/v2.1/servers/7a5dd9d2-a5d0-49a4-bc75-727de7076c66 => generated 1759 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 03:00:35.317785 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [req-c7736518-f867-4460-bafc-98f35203f89f req-80939843-244e-4cda-8504-8d056db46793 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "431b9c6e-48ce-4fa6-a266-cb5b04556cf1", "tag": "bc546a7e-8244-4bb2-a21a-ee3767b86ae3"}]} {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 03:00:35.327422 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [req-c7736518-f867-4460-bafc-98f35203f89f req-80939843-244e-4cda-8504-8d056db46793 service nova] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 03:00:35.327867 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [req-c7736518-f867-4460-bafc-98f35203f89f req-80939843-244e-4cda-8504-8d056db46793 service nova] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 03:00:35.339011 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.compute.server_external_events [req-c7736518-f867-4460-bafc-98f35203f89f req-80939843-244e-4cda-8504-8d056db46793 service nova] Creating event network-changed:bc546a7e-8244-4bb2-a21a-ee3767b86ae3 for instance 431b9c6e-48ce-4fa6-a266-cb5b04556cf1 on hv-cinder-82725 Mar 05 03:00:35.343786 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [req-c7736518-f867-4460-bafc-98f35203f89f req-80939843-244e-4cda-8504-8d056db46793 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030670 Mar 05 03:00:35.345256 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 422/861] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Mar 5 03:00:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 03:00:55.916464 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-cc0df174-a8c3-4c95-b28b-097edd9ea438 tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 03:00:55.917397 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-cc0df174-a8c3-4c95-b28b-097edd9ea438 tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] [instance: 7a5dd9d2-a5d0-49a4-bc75-727de7076c66] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 03:00:55.924123 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-cc0df174-a8c3-4c95-b28b-097edd9ea438 tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 03:00:55.924571 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-cc0df174-a8c3-4c95-b28b-097edd9ea438 tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 03:00:55.925333 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-cc0df174-a8c3-4c95-b28b-097edd9ea438 tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 03:00:55.925770 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-cc0df174-a8c3-4c95-b28b-097edd9ea438 tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 03:00:55.996243 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-cc0df174-a8c3-4c95-b28b-097edd9ea438 tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] 10.222.0.26 "POST /compute/v2.1/servers/7a5dd9d2-a5d0-49a4-bc75-727de7076c66/action" status: 202 len: 0 microversion: 2.1 time: 0.083459 Mar 05 03:00:55.997593 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 440/862] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Mar 5 03:00:55 2022] POST /compute/v2.1/servers/7a5dd9d2-a5d0-49a4-bc75-727de7076c66/action => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 05 03:00:56.007194 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-c43936d4-ad34-438c-ae2c-4b27e222c19c tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 03:00:56.007904 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-c43936d4-ad34-438c-ae2c-4b27e222c19c tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] [instance: 7a5dd9d2-a5d0-49a4-bc75-727de7076c66] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 03:00:56.014250 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-c43936d4-ad34-438c-ae2c-4b27e222c19c tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 03:00:56.014643 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-c43936d4-ad34-438c-ae2c-4b27e222c19c tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 03:00:56.015426 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-c43936d4-ad34-438c-ae2c-4b27e222c19c tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 03:00:56.015864 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-c43936d4-ad34-438c-ae2c-4b27e222c19c tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 03:00:56.260135 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-c43936d4-ad34-438c-ae2c-4b27e222c19c tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18be544fa93d45b5866e5457c92cbeed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afdf34f696b743d1885e8c9895a1d4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 03:00:56.268244 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-c43936d4-ad34-438c-ae2c-4b27e222c19c tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] 10.222.0.26 "GET /compute/v2.1/servers/7a5dd9d2-a5d0-49a4-bc75-727de7076c66" status: 200 len: 1751 microversion: 2.1 time: 0.266871 Mar 05 03:00:56.268813 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 423/863] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 03:00:56 2022] GET /compute/v2.1/servers/7a5dd9d2-a5d0-49a4-bc75-727de7076c66 => generated 1751 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 03:00:57.287883 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-dd66e404-442a-4d68-8ed2-1a3d0b985838 tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 03:00:57.288574 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-dd66e404-442a-4d68-8ed2-1a3d0b985838 tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] [instance: 7a5dd9d2-a5d0-49a4-bc75-727de7076c66] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 03:00:57.294452 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-dd66e404-442a-4d68-8ed2-1a3d0b985838 tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 03:00:57.294904 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-dd66e404-442a-4d68-8ed2-1a3d0b985838 tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 03:00:57.295661 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-dd66e404-442a-4d68-8ed2-1a3d0b985838 tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 03:00:57.296091 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-dd66e404-442a-4d68-8ed2-1a3d0b985838 tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 03:00:57.439125 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-dd66e404-442a-4d68-8ed2-1a3d0b985838 tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18be544fa93d45b5866e5457c92cbeed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afdf34f696b743d1885e8c9895a1d4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 03:00:57.448720 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-dd66e404-442a-4d68-8ed2-1a3d0b985838 tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] 10.222.0.26 "GET /compute/v2.1/servers/7a5dd9d2-a5d0-49a4-bc75-727de7076c66" status: 200 len: 1756 microversion: 2.1 time: 0.165997 Mar 05 03:00:57.449230 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 441/864] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 03:00:57 2022] GET /compute/v2.1/servers/7a5dd9d2-a5d0-49a4-bc75-727de7076c66 => generated 1756 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 03:00:58.465690 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-571eae57-1c81-46b7-b7c3-5ed6e947c0a2 tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 03:00:58.466340 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-571eae57-1c81-46b7-b7c3-5ed6e947c0a2 tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] [instance: 7a5dd9d2-a5d0-49a4-bc75-727de7076c66] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 03:00:58.474072 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-571eae57-1c81-46b7-b7c3-5ed6e947c0a2 tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 03:00:58.474529 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-571eae57-1c81-46b7-b7c3-5ed6e947c0a2 tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 03:00:58.475302 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-571eae57-1c81-46b7-b7c3-5ed6e947c0a2 tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 03:00:58.475741 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-571eae57-1c81-46b7-b7c3-5ed6e947c0a2 tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 03:00:58.637389 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-571eae57-1c81-46b7-b7c3-5ed6e947c0a2 tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18be544fa93d45b5866e5457c92cbeed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afdf34f696b743d1885e8c9895a1d4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 03:00:58.646523 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-571eae57-1c81-46b7-b7c3-5ed6e947c0a2 tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] 10.222.0.26 "GET /compute/v2.1/servers/7a5dd9d2-a5d0-49a4-bc75-727de7076c66" status: 200 len: 1756 microversion: 2.1 time: 0.184641 Mar 05 03:00:58.647107 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 424/865] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 03:00:58 2022] GET /compute/v2.1/servers/7a5dd9d2-a5d0-49a4-bc75-727de7076c66 => generated 1756 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 03:00:59.663309 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-3fdcbafd-5125-42e1-9607-14a5c20649fd tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 03:00:59.663938 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-3fdcbafd-5125-42e1-9607-14a5c20649fd tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] [instance: 7a5dd9d2-a5d0-49a4-bc75-727de7076c66] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 03:00:59.670101 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-3fdcbafd-5125-42e1-9607-14a5c20649fd tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 03:00:59.670675 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-3fdcbafd-5125-42e1-9607-14a5c20649fd tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 03:00:59.671434 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-3fdcbafd-5125-42e1-9607-14a5c20649fd tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 03:00:59.671865 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-3fdcbafd-5125-42e1-9607-14a5c20649fd tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 03:00:59.834918 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-3fdcbafd-5125-42e1-9607-14a5c20649fd tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18be544fa93d45b5866e5457c92cbeed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afdf34f696b743d1885e8c9895a1d4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 03:00:59.845432 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-3fdcbafd-5125-42e1-9607-14a5c20649fd tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] 10.222.0.26 "GET /compute/v2.1/servers/7a5dd9d2-a5d0-49a4-bc75-727de7076c66" status: 200 len: 1756 microversion: 2.1 time: 0.185949 Mar 05 03:00:59.846239 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 442/866] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 03:00:59 2022] GET /compute/v2.1/servers/7a5dd9d2-a5d0-49a4-bc75-727de7076c66 => generated 1756 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 03:01:00.863629 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-e1244784-082b-4e1e-b2f4-df43ac6ea4c9 tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 03:01:00.864260 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-e1244784-082b-4e1e-b2f4-df43ac6ea4c9 tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] [instance: 7a5dd9d2-a5d0-49a4-bc75-727de7076c66] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 03:01:00.870552 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-e1244784-082b-4e1e-b2f4-df43ac6ea4c9 tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 03:01:00.871005 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-e1244784-082b-4e1e-b2f4-df43ac6ea4c9 tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 03:01:00.871775 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-e1244784-082b-4e1e-b2f4-df43ac6ea4c9 tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 03:01:00.872319 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-e1244784-082b-4e1e-b2f4-df43ac6ea4c9 tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 03:01:01.031344 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-e1244784-082b-4e1e-b2f4-df43ac6ea4c9 tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18be544fa93d45b5866e5457c92cbeed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afdf34f696b743d1885e8c9895a1d4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 03:01:01.039247 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-e1244784-082b-4e1e-b2f4-df43ac6ea4c9 tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] 10.222.0.26 "GET /compute/v2.1/servers/7a5dd9d2-a5d0-49a4-bc75-727de7076c66" status: 200 len: 1756 microversion: 2.1 time: 0.179592 Mar 05 03:01:01.039824 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 425/867] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 03:01:00 2022] GET /compute/v2.1/servers/7a5dd9d2-a5d0-49a4-bc75-727de7076c66 => generated 1756 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 03:01:02.056903 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-8492a4ef-4005-49d4-b70f-dbcdbc14ecb7 tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 03:01:02.057574 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-8492a4ef-4005-49d4-b70f-dbcdbc14ecb7 tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] [instance: 7a5dd9d2-a5d0-49a4-bc75-727de7076c66] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 03:01:02.063532 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-8492a4ef-4005-49d4-b70f-dbcdbc14ecb7 tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 03:01:02.064042 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-8492a4ef-4005-49d4-b70f-dbcdbc14ecb7 tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 03:01:02.064817 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-8492a4ef-4005-49d4-b70f-dbcdbc14ecb7 tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 03:01:02.065241 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-8492a4ef-4005-49d4-b70f-dbcdbc14ecb7 tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 03:01:02.213274 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-8492a4ef-4005-49d4-b70f-dbcdbc14ecb7 tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18be544fa93d45b5866e5457c92cbeed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afdf34f696b743d1885e8c9895a1d4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 03:01:02.222259 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-8492a4ef-4005-49d4-b70f-dbcdbc14ecb7 tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] 10.222.0.26 "GET /compute/v2.1/servers/7a5dd9d2-a5d0-49a4-bc75-727de7076c66" status: 200 len: 1756 microversion: 2.1 time: 0.169552 Mar 05 03:01:02.222839 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 443/868] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 03:01:02 2022] GET /compute/v2.1/servers/7a5dd9d2-a5d0-49a4-bc75-727de7076c66 => generated 1756 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 03:01:03.240776 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-d464d72c-35ef-4c79-8b6a-12c3f6977be4 tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 03:01:03.241434 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-d464d72c-35ef-4c79-8b6a-12c3f6977be4 tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] [instance: 7a5dd9d2-a5d0-49a4-bc75-727de7076c66] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 03:01:03.247982 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-d464d72c-35ef-4c79-8b6a-12c3f6977be4 tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 03:01:03.248434 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-d464d72c-35ef-4c79-8b6a-12c3f6977be4 tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 03:01:03.249196 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-d464d72c-35ef-4c79-8b6a-12c3f6977be4 tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 03:01:03.249622 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-d464d72c-35ef-4c79-8b6a-12c3f6977be4 tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 03:01:03.401721 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-d464d72c-35ef-4c79-8b6a-12c3f6977be4 tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18be544fa93d45b5866e5457c92cbeed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afdf34f696b743d1885e8c9895a1d4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 03:01:03.410322 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-d464d72c-35ef-4c79-8b6a-12c3f6977be4 tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] 10.222.0.26 "GET /compute/v2.1/servers/7a5dd9d2-a5d0-49a4-bc75-727de7076c66" status: 200 len: 1756 microversion: 2.1 time: 0.174219 Mar 05 03:01:03.410893 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 426/869] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 03:01:03 2022] GET /compute/v2.1/servers/7a5dd9d2-a5d0-49a4-bc75-727de7076c66 => generated 1756 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 03:01:04.427258 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-aaed1e92-b853-4ab9-b265-6b2ea30963e9 tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 03:01:04.428156 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-aaed1e92-b853-4ab9-b265-6b2ea30963e9 tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] [instance: 7a5dd9d2-a5d0-49a4-bc75-727de7076c66] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 03:01:04.434293 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-aaed1e92-b853-4ab9-b265-6b2ea30963e9 tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 03:01:04.434746 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-aaed1e92-b853-4ab9-b265-6b2ea30963e9 tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 03:01:04.435520 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-aaed1e92-b853-4ab9-b265-6b2ea30963e9 tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 03:01:04.435952 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-aaed1e92-b853-4ab9-b265-6b2ea30963e9 tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 03:01:04.584976 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-aaed1e92-b853-4ab9-b265-6b2ea30963e9 tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18be544fa93d45b5866e5457c92cbeed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afdf34f696b743d1885e8c9895a1d4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 03:01:04.592684 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-aaed1e92-b853-4ab9-b265-6b2ea30963e9 tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] 10.222.0.26 "GET /compute/v2.1/servers/7a5dd9d2-a5d0-49a4-bc75-727de7076c66" status: 200 len: 1756 microversion: 2.1 time: 0.169288 Mar 05 03:01:04.593218 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 444/870] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 03:01:04 2022] GET /compute/v2.1/servers/7a5dd9d2-a5d0-49a4-bc75-727de7076c66 => generated 1756 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 03:01:05.609753 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-15604e87-a204-4afd-aedb-9035249c11cc tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 03:01:05.611006 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-15604e87-a204-4afd-aedb-9035249c11cc tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] [instance: 7a5dd9d2-a5d0-49a4-bc75-727de7076c66] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 03:01:05.618184 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-15604e87-a204-4afd-aedb-9035249c11cc tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 03:01:05.618641 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-15604e87-a204-4afd-aedb-9035249c11cc tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 03:01:05.619414 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-15604e87-a204-4afd-aedb-9035249c11cc tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 03:01:05.619848 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-15604e87-a204-4afd-aedb-9035249c11cc tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 03:01:05.768737 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-15604e87-a204-4afd-aedb-9035249c11cc tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18be544fa93d45b5866e5457c92cbeed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afdf34f696b743d1885e8c9895a1d4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 03:01:05.777491 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-15604e87-a204-4afd-aedb-9035249c11cc tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] 10.222.0.26 "GET /compute/v2.1/servers/7a5dd9d2-a5d0-49a4-bc75-727de7076c66" status: 200 len: 1756 microversion: 2.1 time: 0.171506 Mar 05 03:01:05.778088 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 427/871] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 03:01:05 2022] GET /compute/v2.1/servers/7a5dd9d2-a5d0-49a4-bc75-727de7076c66 => generated 1756 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 03:01:06.795068 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-02ad9fdb-f07a-439a-8ea7-37c590bf2fd7 tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 03:01:06.795622 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-02ad9fdb-f07a-439a-8ea7-37c590bf2fd7 tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] [instance: 7a5dd9d2-a5d0-49a4-bc75-727de7076c66] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 03:01:06.802884 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-02ad9fdb-f07a-439a-8ea7-37c590bf2fd7 tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 03:01:06.803338 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-02ad9fdb-f07a-439a-8ea7-37c590bf2fd7 tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 03:01:06.804110 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-02ad9fdb-f07a-439a-8ea7-37c590bf2fd7 tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 03:01:06.804549 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-02ad9fdb-f07a-439a-8ea7-37c590bf2fd7 tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 03:01:06.954769 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-02ad9fdb-f07a-439a-8ea7-37c590bf2fd7 tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18be544fa93d45b5866e5457c92cbeed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afdf34f696b743d1885e8c9895a1d4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 03:01:06.962663 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-02ad9fdb-f07a-439a-8ea7-37c590bf2fd7 tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] 10.222.0.26 "GET /compute/v2.1/servers/7a5dd9d2-a5d0-49a4-bc75-727de7076c66" status: 200 len: 1756 microversion: 2.1 time: 0.171509 Mar 05 03:01:06.963235 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 445/872] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 03:01:06 2022] GET /compute/v2.1/servers/7a5dd9d2-a5d0-49a4-bc75-727de7076c66 => generated 1756 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 03:01:07.980538 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-c2a68d9c-64e9-4a59-82d3-27d993320bdf tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 03:01:07.981132 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-c2a68d9c-64e9-4a59-82d3-27d993320bdf tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] [instance: 7a5dd9d2-a5d0-49a4-bc75-727de7076c66] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 03:01:07.988897 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-c2a68d9c-64e9-4a59-82d3-27d993320bdf tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 03:01:07.989341 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-c2a68d9c-64e9-4a59-82d3-27d993320bdf tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 03:01:07.990148 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-c2a68d9c-64e9-4a59-82d3-27d993320bdf tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 03:01:07.990587 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-c2a68d9c-64e9-4a59-82d3-27d993320bdf tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 03:01:08.141114 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-c2a68d9c-64e9-4a59-82d3-27d993320bdf tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18be544fa93d45b5866e5457c92cbeed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afdf34f696b743d1885e8c9895a1d4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 03:01:08.148827 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-c2a68d9c-64e9-4a59-82d3-27d993320bdf tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] 10.222.0.26 "GET /compute/v2.1/servers/7a5dd9d2-a5d0-49a4-bc75-727de7076c66" status: 200 len: 1759 microversion: 2.1 time: 0.172421 Mar 05 03:01:08.149387 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 428/873] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 03:01:07 2022] GET /compute/v2.1/servers/7a5dd9d2-a5d0-49a4-bc75-727de7076c66 => generated 1759 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 03:01:40.603173 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-06f5fd0f-7860-4310-9d7b-d96a18a129a2 tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-290356933"}} {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 03:01:40.603769 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-06f5fd0f-7860-4310-9d7b-d96a18a129a2 tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] [instance: 7a5dd9d2-a5d0-49a4-bc75-727de7076c66] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 03:01:40.609684 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-06f5fd0f-7860-4310-9d7b-d96a18a129a2 tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 03:01:40.610195 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-06f5fd0f-7860-4310-9d7b-d96a18a129a2 tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 03:01:40.610965 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-06f5fd0f-7860-4310-9d7b-d96a18a129a2 tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 03:01:40.611402 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-06f5fd0f-7860-4310-9d7b-d96a18a129a2 tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 03:01:40.740879 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.network.security_group_api [None req-06f5fd0f-7860-4310-9d7b-d96a18a129a2 tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] Removing security group b5840c17-46ee-4d84-909d-c6c53c7dcf63 from port 789f23b9-7562-4e04-91c4-acdf502fe56a Mar 05 03:01:41.070063 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-06f5fd0f-7860-4310-9d7b-d96a18a129a2 tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] 10.222.0.26 "POST /compute/v2.1/servers/7a5dd9d2-a5d0-49a4-bc75-727de7076c66/action" status: 202 len: 0 microversion: 2.1 time: 0.471588 Mar 05 03:01:41.070875 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 446/874] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Mar 5 03:01:40 2022] POST /compute/v2.1/servers/7a5dd9d2-a5d0-49a4-bc75-727de7076c66/action => generated 0 bytes in 473 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 05 03:01:41.083474 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [req-c27e729d-ff2f-4299-98e1-305e44c19f06 req-d5b67c61-d8f5-45bb-bd06-1670e35e49c2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7a5dd9d2-a5d0-49a4-bc75-727de7076c66", "tag": "789f23b9-7562-4e04-91c4-acdf502fe56a"}]} {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 03:01:41.096986 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [req-c27e729d-ff2f-4299-98e1-305e44c19f06 req-d5b67c61-d8f5-45bb-bd06-1670e35e49c2 service nova] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 03:01:41.097692 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [req-c27e729d-ff2f-4299-98e1-305e44c19f06 req-d5b67c61-d8f5-45bb-bd06-1670e35e49c2 service nova] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 03:01:41.119484 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.compute.server_external_events [req-c27e729d-ff2f-4299-98e1-305e44c19f06 req-d5b67c61-d8f5-45bb-bd06-1670e35e49c2 service nova] Creating event network-changed:789f23b9-7562-4e04-91c4-acdf502fe56a for instance 7a5dd9d2-a5d0-49a4-bc75-727de7076c66 on hv-cinder-82725 Mar 05 03:01:41.126339 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [req-c27e729d-ff2f-4299-98e1-305e44c19f06 req-d5b67c61-d8f5-45bb-bd06-1670e35e49c2 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051007 Mar 05 03:01:41.127134 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 429/875] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Mar 5 03:01:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 03:01:42.456871 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [req-2b384448-04f8-4436-838e-2a0b3ffd67ad req-48519101-43a8-4a81-a5ef-f487ba09071a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7a5dd9d2-a5d0-49a4-bc75-727de7076c66", "tag": "789f23b9-7562-4e04-91c4-acdf502fe56a"}]} {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 03:01:42.462272 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-9296788d-74c0-4aa7-ad11-8e4e8ae06403 tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 03:01:42.466961 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-9296788d-74c0-4aa7-ad11-8e4e8ae06403 tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] [instance: 7a5dd9d2-a5d0-49a4-bc75-727de7076c66] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 03:01:42.473204 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [req-2b384448-04f8-4436-838e-2a0b3ffd67ad req-48519101-43a8-4a81-a5ef-f487ba09071a service nova] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 03:01:42.473756 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [req-2b384448-04f8-4436-838e-2a0b3ffd67ad req-48519101-43a8-4a81-a5ef-f487ba09071a service nova] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 03:01:42.475889 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-9296788d-74c0-4aa7-ad11-8e4e8ae06403 tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 03:01:42.476654 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-9296788d-74c0-4aa7-ad11-8e4e8ae06403 tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 03:01:42.477495 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-9296788d-74c0-4aa7-ad11-8e4e8ae06403 tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 03:01:42.478019 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-9296788d-74c0-4aa7-ad11-8e4e8ae06403 tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 03:01:42.486320 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.compute.server_external_events [req-2b384448-04f8-4436-838e-2a0b3ffd67ad req-48519101-43a8-4a81-a5ef-f487ba09071a service nova] Creating event network-changed:789f23b9-7562-4e04-91c4-acdf502fe56a for instance 7a5dd9d2-a5d0-49a4-bc75-727de7076c66 on hv-cinder-82725 Mar 05 03:01:42.491612 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [req-2b384448-04f8-4436-838e-2a0b3ffd67ad req-48519101-43a8-4a81-a5ef-f487ba09071a service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038706 Mar 05 03:01:42.492219 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 430/876] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Mar 5 03:01:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 03:01:42.562558 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.objects.instance [None req-9296788d-74c0-4aa7-ad11-8e4e8ae06403 tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] Lazy-loading 'services' on Instance uuid 7a5dd9d2-a5d0-49a4-bc75-727de7076c66 {{(pid=123545) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 05 03:01:42.640470 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-9296788d-74c0-4aa7-ad11-8e4e8ae06403 tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] 10.222.0.26 "DELETE /compute/v2.1/servers/7a5dd9d2-a5d0-49a4-bc75-727de7076c66/os-volume_attachments/7a693733-62be-4289-aad8-e7b76be96c04" status: 202 len: 0 microversion: 2.1 time: 0.190071 Mar 05 03:01:42.641764 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 447/877] 10.222.0.26 () {58 vars in 1415 bytes} [Sat Mar 5 03:01:42 2022] DELETE /compute/v2.1/servers/7a5dd9d2-a5d0-49a4-bc75-727de7076c66/os-volume_attachments/7a693733-62be-4289-aad8-e7b76be96c04 => generated 0 bytes in 192 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 05 03:01:42.651893 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-a4b522b8-900f-40ba-af47-a43340d6eabf tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 03:01:42.653413 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-a4b522b8-900f-40ba-af47-a43340d6eabf tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] [instance: 7a5dd9d2-a5d0-49a4-bc75-727de7076c66] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 03:01:42.660643 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-a4b522b8-900f-40ba-af47-a43340d6eabf tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 03:01:42.662175 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-a4b522b8-900f-40ba-af47-a43340d6eabf tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 03:01:42.663393 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-a4b522b8-900f-40ba-af47-a43340d6eabf tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 03:01:42.664081 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-a4b522b8-900f-40ba-af47-a43340d6eabf tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 03:01:42.704501 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-a4b522b8-900f-40ba-af47-a43340d6eabf tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] 10.222.0.26 "GET /compute/v2.1/servers/7a5dd9d2-a5d0-49a4-bc75-727de7076c66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056969 Mar 05 03:01:42.705632 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 431/878] 10.222.0.26 () {58 vars in 1301 bytes} [Sat Mar 5 03:01:42 2022] GET /compute/v2.1/servers/7a5dd9d2-a5d0-49a4-bc75-727de7076c66/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 03:01:43.718260 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-91377364-621a-4799-a321-6b0f4002c6cb tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 03:01:43.719296 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-91377364-621a-4799-a321-6b0f4002c6cb tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] [instance: 7a5dd9d2-a5d0-49a4-bc75-727de7076c66] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 03:01:43.725369 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-91377364-621a-4799-a321-6b0f4002c6cb tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 03:01:43.725807 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-91377364-621a-4799-a321-6b0f4002c6cb tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 03:01:43.726856 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-91377364-621a-4799-a321-6b0f4002c6cb tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 03:01:43.727287 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-91377364-621a-4799-a321-6b0f4002c6cb tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 03:01:43.756232 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-91377364-621a-4799-a321-6b0f4002c6cb tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] 10.222.0.26 "GET /compute/v2.1/servers/7a5dd9d2-a5d0-49a4-bc75-727de7076c66/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042707 Mar 05 03:01:43.756795 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 448/879] 10.222.0.26 () {58 vars in 1301 bytes} [Sat Mar 5 03:01:43 2022] GET /compute/v2.1/servers/7a5dd9d2-a5d0-49a4-bc75-727de7076c66/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 05 03:01:43.766615 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-7f0e8e15-c923-495d-a6b7-62fe7740fa0b tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 03:01:43.767099 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-7f0e8e15-c923-495d-a6b7-62fe7740fa0b tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] [instance: 7a5dd9d2-a5d0-49a4-bc75-727de7076c66] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 03:01:43.773612 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-7f0e8e15-c923-495d-a6b7-62fe7740fa0b tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 03:01:43.774095 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-7f0e8e15-c923-495d-a6b7-62fe7740fa0b tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 03:01:43.774896 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-7f0e8e15-c923-495d-a6b7-62fe7740fa0b tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 03:01:43.775328 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-7f0e8e15-c923-495d-a6b7-62fe7740fa0b tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 03:01:43.847047 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.wsgi [None req-7f0e8e15-c923-495d-a6b7-62fe7740fa0b tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] HTTP exception thrown: Instance 7a5dd9d2-a5d0-49a4-bc75-727de7076c66 is not attached to volume 7a693733-62be-4289-aad8-e7b76be96c04 Mar 05 03:01:43.847647 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-7f0e8e15-c923-495d-a6b7-62fe7740fa0b tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] Returning 404 to user: Instance 7a5dd9d2-a5d0-49a4-bc75-727de7076c66 is not attached to volume 7a693733-62be-4289-aad8-e7b76be96c04 {{(pid=123546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 03:01:43.848481 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-7f0e8e15-c923-495d-a6b7-62fe7740fa0b tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] 10.222.0.26 "DELETE /compute/v2.1/servers/7a5dd9d2-a5d0-49a4-bc75-727de7076c66/os-volume_attachments/7a693733-62be-4289-aad8-e7b76be96c04" status: 404 len: 154 microversion: 2.1 time: 0.085891 Mar 05 03:01:43.849270 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 432/880] 10.222.0.26 () {58 vars in 1415 bytes} [Sat Mar 5 03:01:43 2022] DELETE /compute/v2.1/servers/7a5dd9d2-a5d0-49a4-bc75-727de7076c66/os-volume_attachments/7a693733-62be-4289-aad8-e7b76be96c04 => generated 154 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 05 03:01:44.979413 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-66f2d393-adbb-47c6-8ef9-d002db6649fe tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 03:01:44.979911 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-66f2d393-adbb-47c6-8ef9-d002db6649fe tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] [instance: 7a5dd9d2-a5d0-49a4-bc75-727de7076c66] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 03:01:44.986121 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-66f2d393-adbb-47c6-8ef9-d002db6649fe tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 03:01:44.986575 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-66f2d393-adbb-47c6-8ef9-d002db6649fe tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 03:01:44.987342 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-66f2d393-adbb-47c6-8ef9-d002db6649fe tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 03:01:44.987776 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-66f2d393-adbb-47c6-8ef9-d002db6649fe tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 03:01:45.010533 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-66f2d393-adbb-47c6-8ef9-d002db6649fe tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] [instance: 7a5dd9d2-a5d0-49a4-bc75-727de7076c66] Going to try to terminate instance {{(pid=123545) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 05 03:01:45.082908 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-66f2d393-adbb-47c6-8ef9-d002db6649fe tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] 10.222.0.26 "DELETE /compute/v2.1/servers/7a5dd9d2-a5d0-49a4-bc75-727de7076c66" status: 204 len: 0 microversion: 2.1 time: 0.107205 Mar 05 03:01:45.084325 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 449/881] 10.222.0.26 () {58 vars in 1238 bytes} [Sat Mar 5 03:01:44 2022] DELETE /compute/v2.1/servers/7a5dd9d2-a5d0-49a4-bc75-727de7076c66 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 05 03:01:45.093470 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-949a3637-bc89-4507-8797-63d117781643 tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 03:01:45.094386 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-949a3637-bc89-4507-8797-63d117781643 tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] [instance: 7a5dd9d2-a5d0-49a4-bc75-727de7076c66] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 03:01:45.102399 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-949a3637-bc89-4507-8797-63d117781643 tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 03:01:45.102930 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-949a3637-bc89-4507-8797-63d117781643 tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 03:01:45.103794 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-949a3637-bc89-4507-8797-63d117781643 tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 03:01:45.104362 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-949a3637-bc89-4507-8797-63d117781643 tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 03:01:45.234984 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-949a3637-bc89-4507-8797-63d117781643 tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18be544fa93d45b5866e5457c92cbeed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afdf34f696b743d1885e8c9895a1d4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 03:01:45.242986 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-949a3637-bc89-4507-8797-63d117781643 tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] 10.222.0.26 "GET /compute/v2.1/servers/7a5dd9d2-a5d0-49a4-bc75-727de7076c66" status: 200 len: 1555 microversion: 2.1 time: 0.154054 Mar 05 03:01:45.243553 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 433/882] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 03:01:45 2022] GET /compute/v2.1/servers/7a5dd9d2-a5d0-49a4-bc75-727de7076c66 => generated 1555 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 03:01:46.261152 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-c69a6baf-ccc2-4b5d-a1f0-b9c00da58743 tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 03:01:46.261845 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-c69a6baf-ccc2-4b5d-a1f0-b9c00da58743 tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] [instance: 7a5dd9d2-a5d0-49a4-bc75-727de7076c66] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 03:01:46.268190 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-c69a6baf-ccc2-4b5d-a1f0-b9c00da58743 tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 03:01:46.268643 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-c69a6baf-ccc2-4b5d-a1f0-b9c00da58743 tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 03:01:46.269401 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-c69a6baf-ccc2-4b5d-a1f0-b9c00da58743 tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 03:01:46.269835 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-c69a6baf-ccc2-4b5d-a1f0-b9c00da58743 tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 03:01:46.407940 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-c69a6baf-ccc2-4b5d-a1f0-b9c00da58743 tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18be544fa93d45b5866e5457c92cbeed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afdf34f696b743d1885e8c9895a1d4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 03:01:46.415744 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-c69a6baf-ccc2-4b5d-a1f0-b9c00da58743 tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] 10.222.0.26 "GET /compute/v2.1/servers/7a5dd9d2-a5d0-49a4-bc75-727de7076c66" status: 200 len: 1555 microversion: 2.1 time: 0.158769 Mar 05 03:01:46.416316 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 450/883] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 03:01:46 2022] GET /compute/v2.1/servers/7a5dd9d2-a5d0-49a4-bc75-727de7076c66 => generated 1555 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 03:01:47.241857 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [req-a3536997-bd16-4515-b1b5-956082437332 req-775f2133-c4c2-490e-8936-83f29b721a24 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a5dd9d2-a5d0-49a4-bc75-727de7076c66", "name": "network-vif-deleted", "tag": "789f23b9-7562-4e04-91c4-acdf502fe56a"}]} {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 03:01:47.252553 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [req-a3536997-bd16-4515-b1b5-956082437332 req-775f2133-c4c2-490e-8936-83f29b721a24 service nova] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 03:01:47.253080 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [req-a3536997-bd16-4515-b1b5-956082437332 req-775f2133-c4c2-490e-8936-83f29b721a24 service nova] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 03:01:47.266162 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.compute.server_external_events [req-a3536997-bd16-4515-b1b5-956082437332 req-775f2133-c4c2-490e-8936-83f29b721a24 service nova] Creating event network-vif-deleted:789f23b9-7562-4e04-91c4-acdf502fe56a for instance 7a5dd9d2-a5d0-49a4-bc75-727de7076c66 on hv-cinder-82725 Mar 05 03:01:47.271797 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [req-a3536997-bd16-4515-b1b5-956082437332 req-775f2133-c4c2-490e-8936-83f29b721a24 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034250 Mar 05 03:01:47.273182 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 434/884] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Mar 5 03:01:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 03:01:47.433019 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-1f4b479e-08e1-48ef-9b83-a341f381520a tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 03:01:47.433614 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-1f4b479e-08e1-48ef-9b83-a341f381520a tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] [instance: 7a5dd9d2-a5d0-49a4-bc75-727de7076c66] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 03:01:47.439915 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-1f4b479e-08e1-48ef-9b83-a341f381520a tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 03:01:47.440364 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-1f4b479e-08e1-48ef-9b83-a341f381520a tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 03:01:47.441123 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-1f4b479e-08e1-48ef-9b83-a341f381520a tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 03:01:47.441597 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-1f4b479e-08e1-48ef-9b83-a341f381520a tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 03:01:47.471489 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-1f4b479e-08e1-48ef-9b83-a341f381520a tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 03:01:47.471859 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-1f4b479e-08e1-48ef-9b83-a341f381520a tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 03:01:47.472300 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.objects.instance [None req-1f4b479e-08e1-48ef-9b83-a341f381520a tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] Lazy-loading 'fault' on Instance uuid 7a5dd9d2-a5d0-49a4-bc75-727de7076c66 {{(pid=123545) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 05 03:01:47.512487 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-1f4b479e-08e1-48ef-9b83-a341f381520a tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18be544fa93d45b5866e5457c92cbeed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afdf34f696b743d1885e8c9895a1d4b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 03:01:47.520088 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-1f4b479e-08e1-48ef-9b83-a341f381520a tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] 10.222.0.26 "GET /compute/v2.1/servers/7a5dd9d2-a5d0-49a4-bc75-727de7076c66" status: 200 len: 1349 microversion: 2.1 time: 0.090924 Mar 05 03:01:47.521603 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 451/885] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 03:01:47 2022] GET /compute/v2.1/servers/7a5dd9d2-a5d0-49a4-bc75-727de7076c66 => generated 1349 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 03:01:48.539001 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-bc5c98e4-25e4-481b-8ccc-2f6a8aa4d52d tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 03:01:48.539692 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-bc5c98e4-25e4-481b-8ccc-2f6a8aa4d52d tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] [instance: 7a5dd9d2-a5d0-49a4-bc75-727de7076c66] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 03:01:48.546161 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-bc5c98e4-25e4-481b-8ccc-2f6a8aa4d52d tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 03:01:48.546610 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-bc5c98e4-25e4-481b-8ccc-2f6a8aa4d52d tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 03:01:48.547369 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-bc5c98e4-25e4-481b-8ccc-2f6a8aa4d52d tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 03:01:48.547800 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-bc5c98e4-25e4-481b-8ccc-2f6a8aa4d52d tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 03:01:48.560531 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.wsgi [None req-bc5c98e4-25e4-481b-8ccc-2f6a8aa4d52d tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] HTTP exception thrown: Instance 7a5dd9d2-a5d0-49a4-bc75-727de7076c66 could not be found. Mar 05 03:01:48.561100 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-bc5c98e4-25e4-481b-8ccc-2f6a8aa4d52d tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] Returning 404 to user: Instance 7a5dd9d2-a5d0-49a4-bc75-727de7076c66 could not be found. {{(pid=123546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 03:01:48.561903 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-bc5c98e4-25e4-481b-8ccc-2f6a8aa4d52d tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] 10.222.0.26 "GET /compute/v2.1/servers/7a5dd9d2-a5d0-49a4-bc75-727de7076c66" status: 404 len: 111 microversion: 2.1 time: 0.027889 Mar 05 03:01:48.562456 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 435/886] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 03:01:48 2022] GET /compute/v2.1/servers/7a5dd9d2-a5d0-49a4-bc75-727de7076c66 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 05 03:01:48.570571 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-4e5b423a-5630-4a2a-b938-7865c352d379 tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] Calling method '.version_select at 0x7f3f61cda160>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 03:01:48.587793 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-4e5b423a-5630-4a2a-b938-7865c352d379 tempest-TestMinimumBasicScenario-103651844 tempest-TestMinimumBasicScenario-103651844-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1735903554" status: 202 len: 0 microversion: 2.1 time: 0.021021 Mar 05 03:01:48.588364 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 452/887] 10.222.0.26 () {58 vars in 1271 bytes} [Sat Mar 5 03:01:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1735903554 => generated 0 bytes in 22 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 05 03:02:28.114421 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 05 03:02:28.115122 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: Sat Mar 5 03:02:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 05 03:02:29.325460 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-7f8ea3f2-5ac2-4b5a-a956-eb35c16c270c tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 03:02:29.326013 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-7f8ea3f2-5ac2-4b5a-a956-eb35c16c270c tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] [instance: 431b9c6e-48ce-4fa6-a266-cb5b04556cf1] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 03:02:29.331872 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-7f8ea3f2-5ac2-4b5a-a956-eb35c16c270c tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 03:02:29.332320 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-7f8ea3f2-5ac2-4b5a-a956-eb35c16c270c tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 03:02:29.333074 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-7f8ea3f2-5ac2-4b5a-a956-eb35c16c270c tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 03:02:29.333506 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-7f8ea3f2-5ac2-4b5a-a956-eb35c16c270c tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 03:02:29.358544 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-7f8ea3f2-5ac2-4b5a-a956-eb35c16c270c tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] [instance: 431b9c6e-48ce-4fa6-a266-cb5b04556cf1] Going to try to terminate instance {{(pid=123546) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 05 03:02:29.434897 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-7f8ea3f2-5ac2-4b5a-a956-eb35c16c270c tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] 10.222.0.26 "DELETE /compute/v2.1/servers/431b9c6e-48ce-4fa6-a266-cb5b04556cf1" status: 204 len: 0 microversion: 2.1 time: 0.113137 Mar 05 03:02:29.435825 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 436/888] 10.222.0.26 () {58 vars in 1238 bytes} [Sat Mar 5 03:02:29 2022] DELETE /compute/v2.1/servers/431b9c6e-48ce-4fa6-a266-cb5b04556cf1 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 05 03:02:29.444523 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-21378d85-2673-45fd-819b-4d4db85dcebc tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 03:02:29.445805 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-21378d85-2673-45fd-819b-4d4db85dcebc tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] [instance: 431b9c6e-48ce-4fa6-a266-cb5b04556cf1] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 03:02:29.452478 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-21378d85-2673-45fd-819b-4d4db85dcebc tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 03:02:29.452931 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-21378d85-2673-45fd-819b-4d4db85dcebc tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 03:02:29.453714 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-21378d85-2673-45fd-819b-4d4db85dcebc tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 03:02:29.454170 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-21378d85-2673-45fd-819b-4d4db85dcebc tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 03:02:29.695673 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-21378d85-2673-45fd-819b-4d4db85dcebc tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53fb7a6cf8b4d47a871ee2a1a24d21f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e08e745e374d92a13f0a03ad69b496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 03:02:29.702889 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-21378d85-2673-45fd-819b-4d4db85dcebc tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] 10.222.0.26 "GET /compute/v2.1/servers/431b9c6e-48ce-4fa6-a266-cb5b04556cf1" status: 200 len: 1580 microversion: 2.1 time: 0.263038 Mar 05 03:02:29.703446 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 453/889] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 03:02:29 2022] GET /compute/v2.1/servers/431b9c6e-48ce-4fa6-a266-cb5b04556cf1 => generated 1580 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 03:02:30.722291 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-9ad07d38-96b9-4459-919a-f5511f4999c6 tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 03:02:30.723002 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-9ad07d38-96b9-4459-919a-f5511f4999c6 tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] [instance: 431b9c6e-48ce-4fa6-a266-cb5b04556cf1] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 03:02:30.730251 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-9ad07d38-96b9-4459-919a-f5511f4999c6 tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 03:02:30.730702 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-9ad07d38-96b9-4459-919a-f5511f4999c6 tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 03:02:30.731484 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-9ad07d38-96b9-4459-919a-f5511f4999c6 tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 03:02:30.731913 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-9ad07d38-96b9-4459-919a-f5511f4999c6 tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 03:02:30.940520 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-9ad07d38-96b9-4459-919a-f5511f4999c6 tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53fb7a6cf8b4d47a871ee2a1a24d21f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e08e745e374d92a13f0a03ad69b496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 03:02:30.947850 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-9ad07d38-96b9-4459-919a-f5511f4999c6 tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] 10.222.0.26 "GET /compute/v2.1/servers/431b9c6e-48ce-4fa6-a266-cb5b04556cf1" status: 200 len: 1580 microversion: 2.1 time: 0.229816 Mar 05 03:02:30.948423 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 437/890] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 03:02:30 2022] GET /compute/v2.1/servers/431b9c6e-48ce-4fa6-a266-cb5b04556cf1 => generated 1580 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 03:02:31.816693 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [req-2531741d-4d57-4721-b8a1-02c374cbeac4 req-0e3e4741-4658-46fc-902b-708c6cb6c552 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "431b9c6e-48ce-4fa6-a266-cb5b04556cf1", "name": "network-vif-deleted", "tag": "bc546a7e-8244-4bb2-a21a-ee3767b86ae3"}]} {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 03:02:31.826514 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [req-2531741d-4d57-4721-b8a1-02c374cbeac4 req-0e3e4741-4658-46fc-902b-708c6cb6c552 service nova] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 03:02:31.826967 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [req-2531741d-4d57-4721-b8a1-02c374cbeac4 req-0e3e4741-4658-46fc-902b-708c6cb6c552 service nova] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 03:02:31.839258 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.compute.server_external_events [req-2531741d-4d57-4721-b8a1-02c374cbeac4 req-0e3e4741-4658-46fc-902b-708c6cb6c552 service nova] Creating event network-vif-deleted:bc546a7e-8244-4bb2-a21a-ee3767b86ae3 for instance 431b9c6e-48ce-4fa6-a266-cb5b04556cf1 on hv-cinder-82725 Mar 05 03:02:31.844393 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [req-2531741d-4d57-4721-b8a1-02c374cbeac4 req-0e3e4741-4658-46fc-902b-708c6cb6c552 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100706 Mar 05 03:02:31.845272 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 454/891] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Mar 5 03:02:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 03:02:31.965617 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-910adfd9-01b3-4cf5-a33c-8c09e5748d98 tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 03:02:31.967071 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-910adfd9-01b3-4cf5-a33c-8c09e5748d98 tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] [instance: 431b9c6e-48ce-4fa6-a266-cb5b04556cf1] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 03:02:31.975420 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-910adfd9-01b3-4cf5-a33c-8c09e5748d98 tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 03:02:31.976953 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-910adfd9-01b3-4cf5-a33c-8c09e5748d98 tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 03:02:31.978028 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-910adfd9-01b3-4cf5-a33c-8c09e5748d98 tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 03:02:31.978735 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-910adfd9-01b3-4cf5-a33c-8c09e5748d98 tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 03:02:32.051816 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-910adfd9-01b3-4cf5-a33c-8c09e5748d98 tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53fb7a6cf8b4d47a871ee2a1a24d21f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e08e745e374d92a13f0a03ad69b496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 03:02:32.060622 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-910adfd9-01b3-4cf5-a33c-8c09e5748d98 tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] 10.222.0.26 "GET /compute/v2.1/servers/431b9c6e-48ce-4fa6-a266-cb5b04556cf1" status: 200 len: 1226 microversion: 2.1 time: 0.099150 Mar 05 03:02:32.061175 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 438/892] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 03:02:31 2022] GET /compute/v2.1/servers/431b9c6e-48ce-4fa6-a266-cb5b04556cf1 => generated 1226 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 03:02:33.077802 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-7e8f49b6-21e1-4356-891a-c4f6a1b056d9 tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 03:02:33.078504 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-7e8f49b6-21e1-4356-891a-c4f6a1b056d9 tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] [instance: 431b9c6e-48ce-4fa6-a266-cb5b04556cf1] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 03:02:33.084613 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-7e8f49b6-21e1-4356-891a-c4f6a1b056d9 tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 03:02:33.086244 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-7e8f49b6-21e1-4356-891a-c4f6a1b056d9 tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 03:02:33.087028 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-7e8f49b6-21e1-4356-891a-c4f6a1b056d9 tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 03:02:33.087468 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-7e8f49b6-21e1-4356-891a-c4f6a1b056d9 tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 03:02:33.100281 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.wsgi [None req-7e8f49b6-21e1-4356-891a-c4f6a1b056d9 tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] HTTP exception thrown: Instance 431b9c6e-48ce-4fa6-a266-cb5b04556cf1 could not be found. Mar 05 03:02:33.101341 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-7e8f49b6-21e1-4356-891a-c4f6a1b056d9 tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Returning 404 to user: Instance 431b9c6e-48ce-4fa6-a266-cb5b04556cf1 could not be found. {{(pid=123545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 03:02:33.102181 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-7e8f49b6-21e1-4356-891a-c4f6a1b056d9 tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] 10.222.0.26 "GET /compute/v2.1/servers/431b9c6e-48ce-4fa6-a266-cb5b04556cf1" status: 404 len: 111 microversion: 2.1 time: 0.029187 Mar 05 03:02:33.102709 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 455/893] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 03:02:33 2022] GET /compute/v2.1/servers/431b9c6e-48ce-4fa6-a266-cb5b04556cf1 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 05 03:02:33.193541 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-550efbbd-d7ff-4689-b00e-82a88aeaebc0 tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-687328619", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1345238013", "security_groups": [{"name": "tempest-secgroup-smoke-1280001705"}], "block_device_mapping_v2": [{"uuid": "10192887-10a3-4ccc-a958-b222816126a9", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "212982fd-ee74-4572-8056-95fa37c5661e"}]}} {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 03:02:33.301846 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.network.neutron [None req-550efbbd-d7ff-4689-b00e-82a88aeaebc0 tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] validate_networks() for [('212982fd-ee74-4572-8056-95fa37c5661e', None, None, None, None, None)] {{(pid=123546) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 05 03:02:33.679984 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.virt.hardware [None req-550efbbd-d7ff-4689-b00e-82a88aeaebc0 tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Flavor limits 0:0:0 {{(pid=123546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 05 03:02:33.679984 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.virt.hardware [None req-550efbbd-d7ff-4689-b00e-82a88aeaebc0 tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Image limits 0:0:0 {{(pid=123546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 05 03:02:33.680408 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.virt.hardware [None req-550efbbd-d7ff-4689-b00e-82a88aeaebc0 tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Flavor pref 0:0:0 {{(pid=123546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 05 03:02:33.681063 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.virt.hardware [None req-550efbbd-d7ff-4689-b00e-82a88aeaebc0 tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Image pref 0:0:0 {{(pid=123546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 05 03:02:33.681212 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.virt.hardware [None req-550efbbd-d7ff-4689-b00e-82a88aeaebc0 tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 05 03:02:33.689826 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-550efbbd-d7ff-4689-b00e-82a88aeaebc0 tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 03:02:33.690307 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-550efbbd-d7ff-4689-b00e-82a88aeaebc0 tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 03:02:33.691110 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-550efbbd-d7ff-4689-b00e-82a88aeaebc0 tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 03:02:33.691546 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-550efbbd-d7ff-4689-b00e-82a88aeaebc0 tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 03:02:33.707897 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.quota [None req-550efbbd-d7ff-4689-b00e-82a88aeaebc0 tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Getting quotas for project 71e08e745e374d92a13f0a03ad69b496. Resources: {'ram', 'cores', 'instances'} {{(pid=123546) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 03:02:33.712144 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.quota [None req-550efbbd-d7ff-4689-b00e-82a88aeaebc0 tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Getting quotas for user d53fb7a6cf8b4d47a871ee2a1a24d21f and project 71e08e745e374d92a13f0a03ad69b496. Resources: {'ram', 'cores', 'instances'} {{(pid=123546) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 03:02:33.767651 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-550efbbd-d7ff-4689-b00e-82a88aeaebc0 tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Going to run 1 instances... {{(pid=123546) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 05 03:02:33.769845 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-550efbbd-d7ff-4689-b00e-82a88aeaebc0 tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] [instance: ad51225a-4c41-4a81-958b-6a46d1a7759d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='10192887-10a3-4ccc-a958-b222816126a9',volume_size=None,volume_type=None)] {{(pid=123546) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 05 03:02:33.894250 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-550efbbd-d7ff-4689-b00e-82a88aeaebc0 tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.704472 Mar 05 03:02:33.894891 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 439/894] 10.222.0.26 () {60 vars in 1146 bytes} [Sat Mar 5 03:02:33 2022] POST /compute/v2.1/servers => generated 406 bytes in 706 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 05 03:02:33.905622 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-11bc49f0-3082-4915-a9f3-231bceb50f6c tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 03:02:33.906353 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-11bc49f0-3082-4915-a9f3-231bceb50f6c tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] [instance: ad51225a-4c41-4a81-958b-6a46d1a7759d] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 03:02:33.960084 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-11bc49f0-3082-4915-a9f3-231bceb50f6c tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53fb7a6cf8b4d47a871ee2a1a24d21f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e08e745e374d92a13f0a03ad69b496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 03:02:33.966597 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-11bc49f0-3082-4915-a9f3-231bceb50f6c tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] 10.222.0.26 "GET /compute/v2.1/servers/ad51225a-4c41-4a81-958b-6a46d1a7759d" status: 200 len: 1094 microversion: 2.1 time: 0.064904 Mar 05 03:02:33.967194 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 456/895] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 03:02:33 2022] GET /compute/v2.1/servers/ad51225a-4c41-4a81-958b-6a46d1a7759d => generated 1094 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 03:02:34.983349 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-96f05120-5832-4568-b169-e1c378f08803 tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 03:02:34.984056 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-96f05120-5832-4568-b169-e1c378f08803 tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] [instance: ad51225a-4c41-4a81-958b-6a46d1a7759d] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 03:02:34.991208 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-96f05120-5832-4568-b169-e1c378f08803 tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 03:02:34.992291 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-96f05120-5832-4568-b169-e1c378f08803 tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 03:02:34.993452 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-96f05120-5832-4568-b169-e1c378f08803 tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 03:02:34.994037 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-96f05120-5832-4568-b169-e1c378f08803 tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 03:02:35.065371 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-96f05120-5832-4568-b169-e1c378f08803 tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53fb7a6cf8b4d47a871ee2a1a24d21f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e08e745e374d92a13f0a03ad69b496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 03:02:35.073318 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-96f05120-5832-4568-b169-e1c378f08803 tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] 10.222.0.26 "GET /compute/v2.1/servers/ad51225a-4c41-4a81-958b-6a46d1a7759d" status: 200 len: 1210 microversion: 2.1 time: 0.093898 Mar 05 03:02:35.074753 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 440/896] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 03:02:34 2022] GET /compute/v2.1/servers/ad51225a-4c41-4a81-958b-6a46d1a7759d => generated 1210 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 03:02:36.091772 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-c66e0e05-8f39-4484-856a-61a4feba4ab6 tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 03:02:36.092370 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-c66e0e05-8f39-4484-856a-61a4feba4ab6 tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] [instance: ad51225a-4c41-4a81-958b-6a46d1a7759d] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 03:02:36.099677 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-c66e0e05-8f39-4484-856a-61a4feba4ab6 tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 03:02:36.100806 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-c66e0e05-8f39-4484-856a-61a4feba4ab6 tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 03:02:36.101613 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-c66e0e05-8f39-4484-856a-61a4feba4ab6 tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 03:02:36.102086 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-c66e0e05-8f39-4484-856a-61a4feba4ab6 tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 03:02:36.283771 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [req-faf28e99-9586-4a95-9705-a88124040153 req-b346cb63-cb05-4f75-a942-c5d16eebf091 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ad51225a-4c41-4a81-958b-6a46d1a7759d", "tag": "646a8079-0c54-4aed-a880-792512b0748a"}]} {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 03:02:36.299051 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [req-faf28e99-9586-4a95-9705-a88124040153 req-b346cb63-cb05-4f75-a942-c5d16eebf091 service nova] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 03:02:36.299855 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [req-faf28e99-9586-4a95-9705-a88124040153 req-b346cb63-cb05-4f75-a942-c5d16eebf091 service nova] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 03:02:36.313266 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.compute.server_external_events [req-faf28e99-9586-4a95-9705-a88124040153 req-b346cb63-cb05-4f75-a942-c5d16eebf091 service nova] Creating event network-changed:646a8079-0c54-4aed-a880-792512b0748a for instance ad51225a-4c41-4a81-958b-6a46d1a7759d on hv-cinder-82725 Mar 05 03:02:36.319819 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [req-faf28e99-9586-4a95-9705-a88124040153 req-b346cb63-cb05-4f75-a942-c5d16eebf091 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039528 Mar 05 03:02:36.321771 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 441/897] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Mar 5 03:02:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 03:02:36.335438 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-c66e0e05-8f39-4484-856a-61a4feba4ab6 tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53fb7a6cf8b4d47a871ee2a1a24d21f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e08e745e374d92a13f0a03ad69b496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 03:02:36.342425 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-c66e0e05-8f39-4484-856a-61a4feba4ab6 tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] 10.222.0.26 "GET /compute/v2.1/servers/ad51225a-4c41-4a81-958b-6a46d1a7759d" status: 200 len: 1266 microversion: 2.1 time: 0.254357 Mar 05 03:02:36.343870 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 457/898] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 03:02:36 2022] GET /compute/v2.1/servers/ad51225a-4c41-4a81-958b-6a46d1a7759d => generated 1266 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 03:02:37.361492 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-59f973bc-e66a-43b5-841c-6cf0912dfbeb tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 03:02:37.362206 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-59f973bc-e66a-43b5-841c-6cf0912dfbeb tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] [instance: ad51225a-4c41-4a81-958b-6a46d1a7759d] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 03:02:37.368784 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-59f973bc-e66a-43b5-841c-6cf0912dfbeb tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 03:02:37.369229 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-59f973bc-e66a-43b5-841c-6cf0912dfbeb tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 03:02:37.370008 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-59f973bc-e66a-43b5-841c-6cf0912dfbeb tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 03:02:37.370444 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-59f973bc-e66a-43b5-841c-6cf0912dfbeb tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 03:02:37.508157 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-59f973bc-e66a-43b5-841c-6cf0912dfbeb tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53fb7a6cf8b4d47a871ee2a1a24d21f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e08e745e374d92a13f0a03ad69b496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 03:02:37.515265 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-59f973bc-e66a-43b5-841c-6cf0912dfbeb tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] 10.222.0.26 "GET /compute/v2.1/servers/ad51225a-4c41-4a81-958b-6a46d1a7759d" status: 200 len: 1266 microversion: 2.1 time: 0.158477 Mar 05 03:02:37.515842 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 442/899] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 03:02:37 2022] GET /compute/v2.1/servers/ad51225a-4c41-4a81-958b-6a46d1a7759d => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 03:02:38.532115 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-ecb49c14-4f85-42b5-9f9c-7aba600ac8f9 tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 03:02:38.532702 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-ecb49c14-4f85-42b5-9f9c-7aba600ac8f9 tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] [instance: ad51225a-4c41-4a81-958b-6a46d1a7759d] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 03:02:38.539521 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-ecb49c14-4f85-42b5-9f9c-7aba600ac8f9 tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 03:02:38.539964 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-ecb49c14-4f85-42b5-9f9c-7aba600ac8f9 tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 03:02:38.540720 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-ecb49c14-4f85-42b5-9f9c-7aba600ac8f9 tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 03:02:38.541155 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-ecb49c14-4f85-42b5-9f9c-7aba600ac8f9 tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 03:02:38.673851 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-ecb49c14-4f85-42b5-9f9c-7aba600ac8f9 tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53fb7a6cf8b4d47a871ee2a1a24d21f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e08e745e374d92a13f0a03ad69b496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 03:02:38.681438 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-ecb49c14-4f85-42b5-9f9c-7aba600ac8f9 tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] 10.222.0.26 "GET /compute/v2.1/servers/ad51225a-4c41-4a81-958b-6a46d1a7759d" status: 200 len: 1266 microversion: 2.1 time: 0.153196 Mar 05 03:02:38.682024 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 458/900] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 03:02:38 2022] GET /compute/v2.1/servers/ad51225a-4c41-4a81-958b-6a46d1a7759d => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 03:02:39.698592 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-18c5e4fa-a6c3-4ee6-a449-0e26317e09c2 tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 03:02:39.699218 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-18c5e4fa-a6c3-4ee6-a449-0e26317e09c2 tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] [instance: ad51225a-4c41-4a81-958b-6a46d1a7759d] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 03:02:39.705506 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-18c5e4fa-a6c3-4ee6-a449-0e26317e09c2 tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 03:02:39.705971 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-18c5e4fa-a6c3-4ee6-a449-0e26317e09c2 tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 03:02:39.706735 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-18c5e4fa-a6c3-4ee6-a449-0e26317e09c2 tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 03:02:39.707166 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-18c5e4fa-a6c3-4ee6-a449-0e26317e09c2 tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 03:02:39.838079 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-18c5e4fa-a6c3-4ee6-a449-0e26317e09c2 tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53fb7a6cf8b4d47a871ee2a1a24d21f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e08e745e374d92a13f0a03ad69b496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 03:02:39.845280 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-18c5e4fa-a6c3-4ee6-a449-0e26317e09c2 tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] 10.222.0.26 "GET /compute/v2.1/servers/ad51225a-4c41-4a81-958b-6a46d1a7759d" status: 200 len: 1266 microversion: 2.1 time: 0.151244 Mar 05 03:02:39.845840 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 443/901] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 03:02:39 2022] GET /compute/v2.1/servers/ad51225a-4c41-4a81-958b-6a46d1a7759d => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 03:02:40.862415 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-4d92a067-702c-4e17-8c45-f00b830526fd tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 03:02:40.863006 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-4d92a067-702c-4e17-8c45-f00b830526fd tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] [instance: ad51225a-4c41-4a81-958b-6a46d1a7759d] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 03:02:40.869410 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-4d92a067-702c-4e17-8c45-f00b830526fd tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 03:02:40.869854 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-4d92a067-702c-4e17-8c45-f00b830526fd tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 03:02:40.870635 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-4d92a067-702c-4e17-8c45-f00b830526fd tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 03:02:40.871066 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-4d92a067-702c-4e17-8c45-f00b830526fd tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 03:02:41.005238 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-4d92a067-702c-4e17-8c45-f00b830526fd tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53fb7a6cf8b4d47a871ee2a1a24d21f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e08e745e374d92a13f0a03ad69b496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 03:02:41.013374 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-4d92a067-702c-4e17-8c45-f00b830526fd tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] 10.222.0.26 "GET /compute/v2.1/servers/ad51225a-4c41-4a81-958b-6a46d1a7759d" status: 200 len: 1266 microversion: 2.1 time: 0.154779 Mar 05 03:02:41.013940 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 459/902] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 03:02:40 2022] GET /compute/v2.1/servers/ad51225a-4c41-4a81-958b-6a46d1a7759d => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 03:02:42.030741 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-f5f57457-c869-4679-8626-f1bab73c131d tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 03:02:42.031283 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-f5f57457-c869-4679-8626-f1bab73c131d tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] [instance: ad51225a-4c41-4a81-958b-6a46d1a7759d] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 03:02:42.037080 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-f5f57457-c869-4679-8626-f1bab73c131d tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 03:02:42.037526 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-f5f57457-c869-4679-8626-f1bab73c131d tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 03:02:42.038311 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-f5f57457-c869-4679-8626-f1bab73c131d tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 03:02:42.038740 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-f5f57457-c869-4679-8626-f1bab73c131d tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 03:02:42.172643 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-f5f57457-c869-4679-8626-f1bab73c131d tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53fb7a6cf8b4d47a871ee2a1a24d21f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e08e745e374d92a13f0a03ad69b496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 03:02:42.179785 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-f5f57457-c869-4679-8626-f1bab73c131d tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] 10.222.0.26 "GET /compute/v2.1/servers/ad51225a-4c41-4a81-958b-6a46d1a7759d" status: 200 len: 1266 microversion: 2.1 time: 0.153136 Mar 05 03:02:42.181508 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 444/903] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 03:02:42 2022] GET /compute/v2.1/servers/ad51225a-4c41-4a81-958b-6a46d1a7759d => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 03:02:43.198041 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-ac318f41-4de7-4d7c-85d0-193d5eb4586d tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 03:02:43.198649 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-ac318f41-4de7-4d7c-85d0-193d5eb4586d tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] [instance: ad51225a-4c41-4a81-958b-6a46d1a7759d] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 03:02:43.204871 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-ac318f41-4de7-4d7c-85d0-193d5eb4586d tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 03:02:43.205323 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-ac318f41-4de7-4d7c-85d0-193d5eb4586d tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 03:02:43.206128 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-ac318f41-4de7-4d7c-85d0-193d5eb4586d tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 03:02:43.206569 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-ac318f41-4de7-4d7c-85d0-193d5eb4586d tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 03:02:43.339029 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-ac318f41-4de7-4d7c-85d0-193d5eb4586d tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53fb7a6cf8b4d47a871ee2a1a24d21f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e08e745e374d92a13f0a03ad69b496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 03:02:43.346179 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-ac318f41-4de7-4d7c-85d0-193d5eb4586d tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] 10.222.0.26 "GET /compute/v2.1/servers/ad51225a-4c41-4a81-958b-6a46d1a7759d" status: 200 len: 1266 microversion: 2.1 time: 0.152519 Mar 05 03:02:43.346729 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 460/904] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 03:02:43 2022] GET /compute/v2.1/servers/ad51225a-4c41-4a81-958b-6a46d1a7759d => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 03:02:44.185864 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 05 03:02:44.186523 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: Sat Mar 5 03:02:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 05 03:02:44.364332 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-cb6ff150-c6cc-41af-b1db-56f7e9175f08 tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 03:02:44.364936 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-cb6ff150-c6cc-41af-b1db-56f7e9175f08 tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] [instance: ad51225a-4c41-4a81-958b-6a46d1a7759d] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 03:02:44.372052 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-cb6ff150-c6cc-41af-b1db-56f7e9175f08 tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 03:02:44.372496 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-cb6ff150-c6cc-41af-b1db-56f7e9175f08 tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 03:02:44.373285 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-cb6ff150-c6cc-41af-b1db-56f7e9175f08 tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 03:02:44.373713 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-cb6ff150-c6cc-41af-b1db-56f7e9175f08 tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 03:02:44.503437 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-cb6ff150-c6cc-41af-b1db-56f7e9175f08 tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53fb7a6cf8b4d47a871ee2a1a24d21f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e08e745e374d92a13f0a03ad69b496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 03:02:44.511210 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-cb6ff150-c6cc-41af-b1db-56f7e9175f08 tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] 10.222.0.26 "GET /compute/v2.1/servers/ad51225a-4c41-4a81-958b-6a46d1a7759d" status: 200 len: 1266 microversion: 2.1 time: 0.150797 Mar 05 03:02:44.511781 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 445/905] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 03:02:44 2022] GET /compute/v2.1/servers/ad51225a-4c41-4a81-958b-6a46d1a7759d => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 03:02:45.528529 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-e2b683fb-5fd3-4ba1-9755-8bdd9e154ab8 tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 03:02:45.529131 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-e2b683fb-5fd3-4ba1-9755-8bdd9e154ab8 tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] [instance: ad51225a-4c41-4a81-958b-6a46d1a7759d] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 03:02:45.535674 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-e2b683fb-5fd3-4ba1-9755-8bdd9e154ab8 tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 03:02:45.536876 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-e2b683fb-5fd3-4ba1-9755-8bdd9e154ab8 tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 03:02:45.536876 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-e2b683fb-5fd3-4ba1-9755-8bdd9e154ab8 tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 03:02:45.537308 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-e2b683fb-5fd3-4ba1-9755-8bdd9e154ab8 tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 03:02:45.671153 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-e2b683fb-5fd3-4ba1-9755-8bdd9e154ab8 tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53fb7a6cf8b4d47a871ee2a1a24d21f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e08e745e374d92a13f0a03ad69b496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 03:02:45.678703 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-e2b683fb-5fd3-4ba1-9755-8bdd9e154ab8 tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] 10.222.0.26 "GET /compute/v2.1/servers/ad51225a-4c41-4a81-958b-6a46d1a7759d" status: 200 len: 1266 microversion: 2.1 time: 0.154758 Mar 05 03:02:45.680221 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 461/906] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 03:02:45 2022] GET /compute/v2.1/servers/ad51225a-4c41-4a81-958b-6a46d1a7759d => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 03:02:45.764134 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [req-cfc2e228-b48b-45cf-93dc-f3865a6f2758 req-0eca796d-95be-4415-ac95-b8c3b33442bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad51225a-4c41-4a81-958b-6a46d1a7759d", "name": "network-vif-plugged", "status": "completed", "tag": "646a8079-0c54-4aed-a880-792512b0748a"}]} {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 03:02:45.771828 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [req-cfc2e228-b48b-45cf-93dc-f3865a6f2758 req-0eca796d-95be-4415-ac95-b8c3b33442bb service nova] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 03:02:45.772273 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [req-cfc2e228-b48b-45cf-93dc-f3865a6f2758 req-0eca796d-95be-4415-ac95-b8c3b33442bb service nova] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 03:02:45.787262 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.compute.server_external_events [req-cfc2e228-b48b-45cf-93dc-f3865a6f2758 req-0eca796d-95be-4415-ac95-b8c3b33442bb service nova] Creating event network-vif-plugged:646a8079-0c54-4aed-a880-792512b0748a for instance ad51225a-4c41-4a81-958b-6a46d1a7759d on hv-cinder-82725 Mar 05 03:02:45.793046 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [req-cfc2e228-b48b-45cf-93dc-f3865a6f2758 req-0eca796d-95be-4415-ac95-b8c3b33442bb service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098084 Mar 05 03:02:45.793672 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 446/907] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Mar 5 03:02:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 03:02:46.697257 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-19cc74bd-53f5-4fdf-be39-e7e51ef26ff2 tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 03:02:46.697858 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-19cc74bd-53f5-4fdf-be39-e7e51ef26ff2 tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] [instance: ad51225a-4c41-4a81-958b-6a46d1a7759d] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 03:02:46.704083 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-19cc74bd-53f5-4fdf-be39-e7e51ef26ff2 tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 03:02:46.704527 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-19cc74bd-53f5-4fdf-be39-e7e51ef26ff2 tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 03:02:46.705282 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-19cc74bd-53f5-4fdf-be39-e7e51ef26ff2 tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 03:02:46.705713 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-19cc74bd-53f5-4fdf-be39-e7e51ef26ff2 tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 03:02:46.838653 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-19cc74bd-53f5-4fdf-be39-e7e51ef26ff2 tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53fb7a6cf8b4d47a871ee2a1a24d21f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e08e745e374d92a13f0a03ad69b496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 03:02:46.845886 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-19cc74bd-53f5-4fdf-be39-e7e51ef26ff2 tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] 10.222.0.26 "GET /compute/v2.1/servers/ad51225a-4c41-4a81-958b-6a46d1a7759d" status: 200 len: 1266 microversion: 2.1 time: 0.153152 Mar 05 03:02:46.846493 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 462/908] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 03:02:46 2022] GET /compute/v2.1/servers/ad51225a-4c41-4a81-958b-6a46d1a7759d => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 03:02:47.864019 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-64e7648b-950a-445e-8e4b-2447dd74a02b tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 03:02:47.864717 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-64e7648b-950a-445e-8e4b-2447dd74a02b tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] [instance: ad51225a-4c41-4a81-958b-6a46d1a7759d] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 03:02:47.871123 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-64e7648b-950a-445e-8e4b-2447dd74a02b tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 03:02:47.871570 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-64e7648b-950a-445e-8e4b-2447dd74a02b tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 03:02:47.872345 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-64e7648b-950a-445e-8e4b-2447dd74a02b tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 03:02:47.872778 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-64e7648b-950a-445e-8e4b-2447dd74a02b tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 03:02:48.008490 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-64e7648b-950a-445e-8e4b-2447dd74a02b tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53fb7a6cf8b4d47a871ee2a1a24d21f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e08e745e374d92a13f0a03ad69b496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 03:02:48.015899 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-64e7648b-950a-445e-8e4b-2447dd74a02b tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] 10.222.0.26 "GET /compute/v2.1/servers/ad51225a-4c41-4a81-958b-6a46d1a7759d" status: 200 len: 1453 microversion: 2.1 time: 0.156546 Mar 05 03:02:48.016467 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 447/909] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 03:02:47 2022] GET /compute/v2.1/servers/ad51225a-4c41-4a81-958b-6a46d1a7759d => generated 1453 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 03:02:48.033982 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-cfe61e67-75f6-4be2-9306-4af131c4d3c6 tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 03:02:48.034556 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-cfe61e67-75f6-4be2-9306-4af131c4d3c6 tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] [instance: ad51225a-4c41-4a81-958b-6a46d1a7759d] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 03:02:48.041054 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-cfe61e67-75f6-4be2-9306-4af131c4d3c6 tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 03:02:48.041505 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-cfe61e67-75f6-4be2-9306-4af131c4d3c6 tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 03:02:48.042306 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-cfe61e67-75f6-4be2-9306-4af131c4d3c6 tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 03:02:48.042750 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-cfe61e67-75f6-4be2-9306-4af131c4d3c6 tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 03:02:48.174192 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-cfe61e67-75f6-4be2-9306-4af131c4d3c6 tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53fb7a6cf8b4d47a871ee2a1a24d21f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e08e745e374d92a13f0a03ad69b496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 03:02:48.181872 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-cfe61e67-75f6-4be2-9306-4af131c4d3c6 tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] 10.222.0.26 "GET /compute/v2.1/servers/ad51225a-4c41-4a81-958b-6a46d1a7759d" status: 200 len: 1453 microversion: 2.1 time: 0.152293 Mar 05 03:02:48.182468 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 463/910] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 03:02:48 2022] GET /compute/v2.1/servers/ad51225a-4c41-4a81-958b-6a46d1a7759d => generated 1453 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 03:02:50.026217 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [req-cd80fda7-555b-46de-8b72-9025e7d18127 req-8197ea7b-f985-4ea3-b1ef-bccd7eb35ba2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ad51225a-4c41-4a81-958b-6a46d1a7759d", "tag": "646a8079-0c54-4aed-a880-792512b0748a"}]} {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 03:02:50.034513 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [req-cd80fda7-555b-46de-8b72-9025e7d18127 req-8197ea7b-f985-4ea3-b1ef-bccd7eb35ba2 service nova] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 03:02:50.034956 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [req-cd80fda7-555b-46de-8b72-9025e7d18127 req-8197ea7b-f985-4ea3-b1ef-bccd7eb35ba2 service nova] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 03:02:50.046330 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.compute.server_external_events [req-cd80fda7-555b-46de-8b72-9025e7d18127 req-8197ea7b-f985-4ea3-b1ef-bccd7eb35ba2 service nova] Creating event network-changed:646a8079-0c54-4aed-a880-792512b0748a for instance ad51225a-4c41-4a81-958b-6a46d1a7759d on hv-cinder-82725 Mar 05 03:02:50.051160 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [req-cd80fda7-555b-46de-8b72-9025e7d18127 req-8197ea7b-f985-4ea3-b1ef-bccd7eb35ba2 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029436 Mar 05 03:02:50.051767 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 448/911] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Mar 5 03:02:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 03:04:27.224517 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-30f37546-b2be-4d04-9286-dfb726782bfd tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1965380272", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1345238013", "security_groups": [{"name": "tempest-secgroup-smoke-1280001705"}], "block_device_mapping_v2": [{"uuid": "e850db6c-1d6d-4d48-8056-64f6d8a92834", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "212982fd-ee74-4572-8056-95fa37c5661e"}]}} {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 03:04:27.332887 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.network.neutron [None req-30f37546-b2be-4d04-9286-dfb726782bfd tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] validate_networks() for [('212982fd-ee74-4572-8056-95fa37c5661e', None, None, None, None, None)] {{(pid=123545) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 05 03:04:27.754574 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.virt.hardware [None req-30f37546-b2be-4d04-9286-dfb726782bfd tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Flavor limits 0:0:0 {{(pid=123545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 05 03:04:27.754992 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.virt.hardware [None req-30f37546-b2be-4d04-9286-dfb726782bfd tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Image limits 0:0:0 {{(pid=123545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 05 03:04:27.755464 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.virt.hardware [None req-30f37546-b2be-4d04-9286-dfb726782bfd tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Flavor pref 0:0:0 {{(pid=123545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 05 03:04:27.755867 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.virt.hardware [None req-30f37546-b2be-4d04-9286-dfb726782bfd tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Image pref 0:0:0 {{(pid=123545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 05 03:04:27.756268 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.virt.hardware [None req-30f37546-b2be-4d04-9286-dfb726782bfd tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 05 03:04:27.765207 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-30f37546-b2be-4d04-9286-dfb726782bfd tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 03:04:27.765654 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-30f37546-b2be-4d04-9286-dfb726782bfd tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 03:04:27.766471 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-30f37546-b2be-4d04-9286-dfb726782bfd tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 03:04:27.766900 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-30f37546-b2be-4d04-9286-dfb726782bfd tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 03:04:27.783258 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.quota [None req-30f37546-b2be-4d04-9286-dfb726782bfd tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Getting quotas for project 71e08e745e374d92a13f0a03ad69b496. Resources: {'ram', 'cores', 'instances'} {{(pid=123545) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 05 03:04:27.786981 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.quota [None req-30f37546-b2be-4d04-9286-dfb726782bfd tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Getting quotas for user d53fb7a6cf8b4d47a871ee2a1a24d21f and project 71e08e745e374d92a13f0a03ad69b496. Resources: {'ram', 'cores', 'instances'} {{(pid=123545) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 05 03:04:27.841821 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-30f37546-b2be-4d04-9286-dfb726782bfd tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Going to run 1 instances... {{(pid=123545) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 05 03:04:27.843926 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-30f37546-b2be-4d04-9286-dfb726782bfd tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] [instance: 09c20a20-b88c-4af5-b7d8-78b500009499] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='e850db6c-1d6d-4d48-8056-64f6d8a92834',volume_size=None,volume_type=None)] {{(pid=123545) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 05 03:04:27.971174 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-30f37546-b2be-4d04-9286-dfb726782bfd tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.751597 Mar 05 03:04:27.971814 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 464/912] 10.222.0.26 () {60 vars in 1146 bytes} [Sat Mar 5 03:04:27 2022] POST /compute/v2.1/servers => generated 406 bytes in 753 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 05 03:04:27.983916 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-8a394759-cb47-4a39-9fdc-8368e9d9efd1 tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 03:04:27.984616 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-8a394759-cb47-4a39-9fdc-8368e9d9efd1 tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] [instance: 09c20a20-b88c-4af5-b7d8-78b500009499] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 03:04:28.047532 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-8a394759-cb47-4a39-9fdc-8368e9d9efd1 tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53fb7a6cf8b4d47a871ee2a1a24d21f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e08e745e374d92a13f0a03ad69b496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 03:04:28.053967 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-8a394759-cb47-4a39-9fdc-8368e9d9efd1 tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] 10.222.0.26 "GET /compute/v2.1/servers/09c20a20-b88c-4af5-b7d8-78b500009499" status: 200 len: 1095 microversion: 2.1 time: 0.075649 Mar 05 03:04:28.054539 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 449/913] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 03:04:27 2022] GET /compute/v2.1/servers/09c20a20-b88c-4af5-b7d8-78b500009499 => generated 1095 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 03:04:29.071285 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-265663f7-4278-4d90-8d00-7603574149fd tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 03:04:29.072545 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-265663f7-4278-4d90-8d00-7603574149fd tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] [instance: 09c20a20-b88c-4af5-b7d8-78b500009499] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 03:04:29.079420 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-265663f7-4278-4d90-8d00-7603574149fd tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 03:04:29.079948 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-265663f7-4278-4d90-8d00-7603574149fd tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 03:04:29.080787 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-265663f7-4278-4d90-8d00-7603574149fd tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 03:04:29.081298 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-265663f7-4278-4d90-8d00-7603574149fd tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 03:04:29.174713 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-265663f7-4278-4d90-8d00-7603574149fd tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53fb7a6cf8b4d47a871ee2a1a24d21f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e08e745e374d92a13f0a03ad69b496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 03:04:29.182655 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-265663f7-4278-4d90-8d00-7603574149fd tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] 10.222.0.26 "GET /compute/v2.1/servers/09c20a20-b88c-4af5-b7d8-78b500009499" status: 200 len: 1211 microversion: 2.1 time: 0.115531 Mar 05 03:04:29.183484 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 465/914] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 03:04:29 2022] GET /compute/v2.1/servers/09c20a20-b88c-4af5-b7d8-78b500009499 => generated 1211 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 03:04:30.153577 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [req-867a3831-c9b6-4102-a61f-60b9e4ed9611 req-95c0fc9c-755b-423a-99d8-d957bbe75640 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "09c20a20-b88c-4af5-b7d8-78b500009499", "tag": "7a3f6fd1-71aa-4f62-9ef6-8356d3beb14b"}]} {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 03:04:30.162994 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [req-867a3831-c9b6-4102-a61f-60b9e4ed9611 req-95c0fc9c-755b-423a-99d8-d957bbe75640 service nova] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 03:04:30.163655 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [req-867a3831-c9b6-4102-a61f-60b9e4ed9611 req-95c0fc9c-755b-423a-99d8-d957bbe75640 service nova] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 03:04:30.186842 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.compute.server_external_events [req-867a3831-c9b6-4102-a61f-60b9e4ed9611 req-95c0fc9c-755b-423a-99d8-d957bbe75640 service nova] Creating event network-changed:7a3f6fd1-71aa-4f62-9ef6-8356d3beb14b for instance 09c20a20-b88c-4af5-b7d8-78b500009499 on hv-cinder-82725 Mar 05 03:04:30.195657 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [req-867a3831-c9b6-4102-a61f-60b9e4ed9611 req-95c0fc9c-755b-423a-99d8-d957bbe75640 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043415 Mar 05 03:04:30.197016 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 450/915] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Mar 5 03:04:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 03:04:30.199876 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-3445b431-4942-46dc-806a-2d824856af90 tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 03:04:30.200492 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-3445b431-4942-46dc-806a-2d824856af90 tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] [instance: 09c20a20-b88c-4af5-b7d8-78b500009499] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 03:04:30.206787 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-3445b431-4942-46dc-806a-2d824856af90 tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 03:04:30.207246 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-3445b431-4942-46dc-806a-2d824856af90 tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 03:04:30.208019 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-3445b431-4942-46dc-806a-2d824856af90 tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 03:04:30.208451 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-3445b431-4942-46dc-806a-2d824856af90 tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 03:04:30.445353 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-3445b431-4942-46dc-806a-2d824856af90 tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53fb7a6cf8b4d47a871ee2a1a24d21f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e08e745e374d92a13f0a03ad69b496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 03:04:30.453266 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-3445b431-4942-46dc-806a-2d824856af90 tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] 10.222.0.26 "GET /compute/v2.1/servers/09c20a20-b88c-4af5-b7d8-78b500009499" status: 200 len: 1267 microversion: 2.1 time: 0.257095 Mar 05 03:04:30.453901 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 466/916] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 03:04:30 2022] GET /compute/v2.1/servers/09c20a20-b88c-4af5-b7d8-78b500009499 => generated 1267 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 03:04:31.471784 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-a2a601db-25bb-4dae-9607-9b29887c9c6f tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 03:04:31.472766 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-a2a601db-25bb-4dae-9607-9b29887c9c6f tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] [instance: 09c20a20-b88c-4af5-b7d8-78b500009499] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 03:04:31.479710 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-a2a601db-25bb-4dae-9607-9b29887c9c6f tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 03:04:31.480161 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-a2a601db-25bb-4dae-9607-9b29887c9c6f tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 03:04:31.480923 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-a2a601db-25bb-4dae-9607-9b29887c9c6f tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 03:04:31.481493 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-a2a601db-25bb-4dae-9607-9b29887c9c6f tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 03:04:31.887038 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-a2a601db-25bb-4dae-9607-9b29887c9c6f tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53fb7a6cf8b4d47a871ee2a1a24d21f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e08e745e374d92a13f0a03ad69b496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 03:04:31.894368 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-a2a601db-25bb-4dae-9607-9b29887c9c6f tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] 10.222.0.26 "GET /compute/v2.1/servers/09c20a20-b88c-4af5-b7d8-78b500009499" status: 200 len: 1267 microversion: 2.1 time: 0.427336 Mar 05 03:04:31.894942 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 451/917] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 03:04:31 2022] GET /compute/v2.1/servers/09c20a20-b88c-4af5-b7d8-78b500009499 => generated 1267 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 03:04:32.911140 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-4f4c269a-8c6e-4556-81a8-d4164441ff34 tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 03:04:32.911754 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-4f4c269a-8c6e-4556-81a8-d4164441ff34 tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] [instance: 09c20a20-b88c-4af5-b7d8-78b500009499] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 03:04:32.918726 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-4f4c269a-8c6e-4556-81a8-d4164441ff34 tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 03:04:32.919180 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-4f4c269a-8c6e-4556-81a8-d4164441ff34 tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 03:04:32.919948 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-4f4c269a-8c6e-4556-81a8-d4164441ff34 tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 03:04:32.920385 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-4f4c269a-8c6e-4556-81a8-d4164441ff34 tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 03:04:33.050253 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-4f4c269a-8c6e-4556-81a8-d4164441ff34 tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53fb7a6cf8b4d47a871ee2a1a24d21f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e08e745e374d92a13f0a03ad69b496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 03:04:33.057878 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-4f4c269a-8c6e-4556-81a8-d4164441ff34 tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] 10.222.0.26 "GET /compute/v2.1/servers/09c20a20-b88c-4af5-b7d8-78b500009499" status: 200 len: 1267 microversion: 2.1 time: 0.150710 Mar 05 03:04:33.058471 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 467/918] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 03:04:32 2022] GET /compute/v2.1/servers/09c20a20-b88c-4af5-b7d8-78b500009499 => generated 1267 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 03:04:34.074943 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-fa8ba681-cc49-46b1-b6ac-7b9653170e05 tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 03:04:34.075494 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-fa8ba681-cc49-46b1-b6ac-7b9653170e05 tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] [instance: 09c20a20-b88c-4af5-b7d8-78b500009499] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 03:04:34.081763 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-fa8ba681-cc49-46b1-b6ac-7b9653170e05 tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 03:04:34.082247 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-fa8ba681-cc49-46b1-b6ac-7b9653170e05 tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 03:04:34.083020 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-fa8ba681-cc49-46b1-b6ac-7b9653170e05 tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 03:04:34.083460 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-fa8ba681-cc49-46b1-b6ac-7b9653170e05 tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 03:04:34.219165 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-fa8ba681-cc49-46b1-b6ac-7b9653170e05 tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53fb7a6cf8b4d47a871ee2a1a24d21f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e08e745e374d92a13f0a03ad69b496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 03:04:34.227316 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-fa8ba681-cc49-46b1-b6ac-7b9653170e05 tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] 10.222.0.26 "GET /compute/v2.1/servers/09c20a20-b88c-4af5-b7d8-78b500009499" status: 200 len: 1267 microversion: 2.1 time: 0.155931 Mar 05 03:04:34.227887 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 452/919] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 03:04:34 2022] GET /compute/v2.1/servers/09c20a20-b88c-4af5-b7d8-78b500009499 => generated 1267 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 03:04:35.244838 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-7fbadeaf-084b-4319-9f43-83bc38777372 tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 03:04:35.245441 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-7fbadeaf-084b-4319-9f43-83bc38777372 tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] [instance: 09c20a20-b88c-4af5-b7d8-78b500009499] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 03:04:35.251751 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-7fbadeaf-084b-4319-9f43-83bc38777372 tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 03:04:35.252202 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-7fbadeaf-084b-4319-9f43-83bc38777372 tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 03:04:35.252953 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-7fbadeaf-084b-4319-9f43-83bc38777372 tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 03:04:35.253383 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-7fbadeaf-084b-4319-9f43-83bc38777372 tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 03:04:35.384079 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-7fbadeaf-084b-4319-9f43-83bc38777372 tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53fb7a6cf8b4d47a871ee2a1a24d21f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e08e745e374d92a13f0a03ad69b496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 03:04:35.391307 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-7fbadeaf-084b-4319-9f43-83bc38777372 tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] 10.222.0.26 "GET /compute/v2.1/servers/09c20a20-b88c-4af5-b7d8-78b500009499" status: 200 len: 1267 microversion: 2.1 time: 0.151031 Mar 05 03:04:35.391871 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 468/920] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 03:04:35 2022] GET /compute/v2.1/servers/09c20a20-b88c-4af5-b7d8-78b500009499 => generated 1267 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 03:04:36.408257 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-8e2150d9-dab9-49fa-a0d9-58672dd4b711 tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 03:04:36.408869 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-8e2150d9-dab9-49fa-a0d9-58672dd4b711 tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] [instance: 09c20a20-b88c-4af5-b7d8-78b500009499] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 03:04:36.415248 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-8e2150d9-dab9-49fa-a0d9-58672dd4b711 tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 03:04:36.415699 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-8e2150d9-dab9-49fa-a0d9-58672dd4b711 tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 03:04:36.416471 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-8e2150d9-dab9-49fa-a0d9-58672dd4b711 tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 03:04:36.416907 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-8e2150d9-dab9-49fa-a0d9-58672dd4b711 tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 03:04:36.550934 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-8e2150d9-dab9-49fa-a0d9-58672dd4b711 tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53fb7a6cf8b4d47a871ee2a1a24d21f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e08e745e374d92a13f0a03ad69b496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 03:04:36.558715 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-8e2150d9-dab9-49fa-a0d9-58672dd4b711 tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] 10.222.0.26 "GET /compute/v2.1/servers/09c20a20-b88c-4af5-b7d8-78b500009499" status: 200 len: 1267 microversion: 2.1 time: 0.154349 Mar 05 03:04:36.559287 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 453/921] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 03:04:36 2022] GET /compute/v2.1/servers/09c20a20-b88c-4af5-b7d8-78b500009499 => generated 1267 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 03:04:37.574331 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-b4754a48-afb6-4d57-a2ed-2c8e85160478 tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 03:04:37.574963 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-b4754a48-afb6-4d57-a2ed-2c8e85160478 tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] [instance: 09c20a20-b88c-4af5-b7d8-78b500009499] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 03:04:37.581134 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-b4754a48-afb6-4d57-a2ed-2c8e85160478 tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 03:04:37.581583 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-b4754a48-afb6-4d57-a2ed-2c8e85160478 tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 03:04:37.582369 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-b4754a48-afb6-4d57-a2ed-2c8e85160478 tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 03:04:37.582798 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-b4754a48-afb6-4d57-a2ed-2c8e85160478 tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 03:04:37.714746 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-b4754a48-afb6-4d57-a2ed-2c8e85160478 tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53fb7a6cf8b4d47a871ee2a1a24d21f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e08e745e374d92a13f0a03ad69b496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 03:04:37.721871 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-b4754a48-afb6-4d57-a2ed-2c8e85160478 tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] 10.222.0.26 "GET /compute/v2.1/servers/09c20a20-b88c-4af5-b7d8-78b500009499" status: 200 len: 1267 microversion: 2.1 time: 0.151325 Mar 05 03:04:37.722736 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 469/922] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 03:04:37 2022] GET /compute/v2.1/servers/09c20a20-b88c-4af5-b7d8-78b500009499 => generated 1267 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 03:04:38.739389 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-c7f84ed3-a95c-4ab1-87f3-84c39f913104 tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 03:04:38.740005 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-c7f84ed3-a95c-4ab1-87f3-84c39f913104 tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] [instance: 09c20a20-b88c-4af5-b7d8-78b500009499] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 03:04:38.746821 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-c7f84ed3-a95c-4ab1-87f3-84c39f913104 tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 03:04:38.747277 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-c7f84ed3-a95c-4ab1-87f3-84c39f913104 tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 03:04:38.748060 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-c7f84ed3-a95c-4ab1-87f3-84c39f913104 tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 03:04:38.748504 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-c7f84ed3-a95c-4ab1-87f3-84c39f913104 tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 03:04:38.884099 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-c7f84ed3-a95c-4ab1-87f3-84c39f913104 tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53fb7a6cf8b4d47a871ee2a1a24d21f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e08e745e374d92a13f0a03ad69b496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 03:04:38.891353 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-c7f84ed3-a95c-4ab1-87f3-84c39f913104 tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] 10.222.0.26 "GET /compute/v2.1/servers/09c20a20-b88c-4af5-b7d8-78b500009499" status: 200 len: 1267 microversion: 2.1 time: 0.155873 Mar 05 03:04:38.891928 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 454/923] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 03:04:38 2022] GET /compute/v2.1/servers/09c20a20-b88c-4af5-b7d8-78b500009499 => generated 1267 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 03:04:39.907882 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-5e3ff49e-2a49-42a6-91e6-5ea3ebf8eba8 tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 03:04:39.908494 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-5e3ff49e-2a49-42a6-91e6-5ea3ebf8eba8 tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] [instance: 09c20a20-b88c-4af5-b7d8-78b500009499] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 03:04:39.914796 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-5e3ff49e-2a49-42a6-91e6-5ea3ebf8eba8 tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 03:04:39.915249 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-5e3ff49e-2a49-42a6-91e6-5ea3ebf8eba8 tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 03:04:39.916018 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-5e3ff49e-2a49-42a6-91e6-5ea3ebf8eba8 tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 03:04:39.916457 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-5e3ff49e-2a49-42a6-91e6-5ea3ebf8eba8 tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 03:04:40.049581 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-5e3ff49e-2a49-42a6-91e6-5ea3ebf8eba8 tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53fb7a6cf8b4d47a871ee2a1a24d21f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e08e745e374d92a13f0a03ad69b496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 03:04:40.057236 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-5e3ff49e-2a49-42a6-91e6-5ea3ebf8eba8 tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] 10.222.0.26 "GET /compute/v2.1/servers/09c20a20-b88c-4af5-b7d8-78b500009499" status: 200 len: 1267 microversion: 2.1 time: 0.153200 Mar 05 03:04:40.057805 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 470/924] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 03:04:39 2022] GET /compute/v2.1/servers/09c20a20-b88c-4af5-b7d8-78b500009499 => generated 1267 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 03:04:40.468064 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [req-db755b94-eb86-4e8f-b2bb-9f9f45988977 req-4fe34e1c-dcc6-45c5-992c-8812014a6850 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "09c20a20-b88c-4af5-b7d8-78b500009499", "name": "network-vif-plugged", "status": "completed", "tag": "7a3f6fd1-71aa-4f62-9ef6-8356d3beb14b"}]} {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 03:04:40.478851 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [req-db755b94-eb86-4e8f-b2bb-9f9f45988977 req-4fe34e1c-dcc6-45c5-992c-8812014a6850 service nova] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 03:04:40.479321 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [req-db755b94-eb86-4e8f-b2bb-9f9f45988977 req-4fe34e1c-dcc6-45c5-992c-8812014a6850 service nova] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 03:04:40.490814 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.compute.server_external_events [req-db755b94-eb86-4e8f-b2bb-9f9f45988977 req-4fe34e1c-dcc6-45c5-992c-8812014a6850 service nova] Creating event network-vif-plugged:7a3f6fd1-71aa-4f62-9ef6-8356d3beb14b for instance 09c20a20-b88c-4af5-b7d8-78b500009499 on hv-cinder-82725 Mar 05 03:04:40.495845 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [req-db755b94-eb86-4e8f-b2bb-9f9f45988977 req-4fe34e1c-dcc6-45c5-992c-8812014a6850 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031477 Mar 05 03:04:40.496671 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 455/925] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Mar 5 03:04:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 03:04:41.074531 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-7087f0a9-ed39-4e06-a39d-cdd510eb1ab4 tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 03:04:41.075140 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-7087f0a9-ed39-4e06-a39d-cdd510eb1ab4 tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] [instance: 09c20a20-b88c-4af5-b7d8-78b500009499] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 03:04:41.081334 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-7087f0a9-ed39-4e06-a39d-cdd510eb1ab4 tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 03:04:41.081782 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-7087f0a9-ed39-4e06-a39d-cdd510eb1ab4 tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 03:04:41.082590 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-7087f0a9-ed39-4e06-a39d-cdd510eb1ab4 tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 03:04:41.083031 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-7087f0a9-ed39-4e06-a39d-cdd510eb1ab4 tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 03:04:41.217739 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-7087f0a9-ed39-4e06-a39d-cdd510eb1ab4 tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53fb7a6cf8b4d47a871ee2a1a24d21f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e08e745e374d92a13f0a03ad69b496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 03:04:41.225155 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-7087f0a9-ed39-4e06-a39d-cdd510eb1ab4 tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] 10.222.0.26 "GET /compute/v2.1/servers/09c20a20-b88c-4af5-b7d8-78b500009499" status: 200 len: 1267 microversion: 2.1 time: 0.155264 Mar 05 03:04:41.225720 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 471/926] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 03:04:41 2022] GET /compute/v2.1/servers/09c20a20-b88c-4af5-b7d8-78b500009499 => generated 1267 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 03:04:42.243379 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-3b6c1994-c2d8-446e-ad0c-f5d4084a8d0d tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 03:04:42.244095 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-3b6c1994-c2d8-446e-ad0c-f5d4084a8d0d tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] [instance: 09c20a20-b88c-4af5-b7d8-78b500009499] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 03:04:42.250691 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-3b6c1994-c2d8-446e-ad0c-f5d4084a8d0d tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 03:04:42.251146 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-3b6c1994-c2d8-446e-ad0c-f5d4084a8d0d tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 03:04:42.251931 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-3b6c1994-c2d8-446e-ad0c-f5d4084a8d0d tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 03:04:42.252369 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-3b6c1994-c2d8-446e-ad0c-f5d4084a8d0d tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 03:04:42.389804 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-3b6c1994-c2d8-446e-ad0c-f5d4084a8d0d tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53fb7a6cf8b4d47a871ee2a1a24d21f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e08e745e374d92a13f0a03ad69b496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 03:04:42.397067 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-3b6c1994-c2d8-446e-ad0c-f5d4084a8d0d tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] 10.222.0.26 "GET /compute/v2.1/servers/09c20a20-b88c-4af5-b7d8-78b500009499" status: 200 len: 1455 microversion: 2.1 time: 0.158234 Mar 05 03:04:42.397645 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 456/927] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 03:04:42 2022] GET /compute/v2.1/servers/09c20a20-b88c-4af5-b7d8-78b500009499 => generated 1455 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 03:04:42.413450 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-bece6352-a25d-4fff-b7ec-213cb6e471eb tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 03:04:42.414139 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-bece6352-a25d-4fff-b7ec-213cb6e471eb tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] [instance: 09c20a20-b88c-4af5-b7d8-78b500009499] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 03:04:42.420466 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-bece6352-a25d-4fff-b7ec-213cb6e471eb tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 03:04:42.420919 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-bece6352-a25d-4fff-b7ec-213cb6e471eb tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 03:04:42.421688 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-bece6352-a25d-4fff-b7ec-213cb6e471eb tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 03:04:42.422164 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-bece6352-a25d-4fff-b7ec-213cb6e471eb tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 03:04:42.709413 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-bece6352-a25d-4fff-b7ec-213cb6e471eb tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53fb7a6cf8b4d47a871ee2a1a24d21f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e08e745e374d92a13f0a03ad69b496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 03:04:42.716931 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-bece6352-a25d-4fff-b7ec-213cb6e471eb tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] 10.222.0.26 "GET /compute/v2.1/servers/09c20a20-b88c-4af5-b7d8-78b500009499" status: 200 len: 1455 microversion: 2.1 time: 0.307331 Mar 05 03:04:42.717500 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 472/928] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 03:04:42 2022] GET /compute/v2.1/servers/09c20a20-b88c-4af5-b7d8-78b500009499 => generated 1455 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 03:04:44.307455 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [req-f3456785-71b9-43f6-a208-35e4f0c06c85 req-c4e83d84-1fac-4a15-b0bd-b7879666e223 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "09c20a20-b88c-4af5-b7d8-78b500009499", "tag": "7a3f6fd1-71aa-4f62-9ef6-8356d3beb14b"}]} {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 03:04:44.315881 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [req-f3456785-71b9-43f6-a208-35e4f0c06c85 req-c4e83d84-1fac-4a15-b0bd-b7879666e223 service nova] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 03:04:44.316448 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [req-f3456785-71b9-43f6-a208-35e4f0c06c85 req-c4e83d84-1fac-4a15-b0bd-b7879666e223 service nova] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 03:04:44.328482 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.compute.server_external_events [req-f3456785-71b9-43f6-a208-35e4f0c06c85 req-c4e83d84-1fac-4a15-b0bd-b7879666e223 service nova] Creating event network-changed:7a3f6fd1-71aa-4f62-9ef6-8356d3beb14b for instance 09c20a20-b88c-4af5-b7d8-78b500009499 on hv-cinder-82725 Mar 05 03:04:44.333366 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [req-f3456785-71b9-43f6-a208-35e4f0c06c85 req-c4e83d84-1fac-4a15-b0bd-b7879666e223 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029917 Mar 05 03:04:44.334008 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 457/929] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Mar 5 03:04:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 03:05:26.661970 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 05 03:05:26.662769 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: Sat Mar 5 03:05:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 05 03:06:04.193826 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 05 03:06:04.194494 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: Sat Mar 5 03:06:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 05 03:06:13.358826 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-36f12272-734e-408b-b648-2c43b9d67ec0 tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 03:06:13.359459 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-36f12272-734e-408b-b648-2c43b9d67ec0 tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] [instance: 09c20a20-b88c-4af5-b7d8-78b500009499] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 03:06:13.361613 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [req-34f1d8d0-1071-4ffb-a884-9751d354bb04 req-2988a804-e212-492e-9e85-cf9290c4caa3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "09c20a20-b88c-4af5-b7d8-78b500009499", "tag": "7a3f6fd1-71aa-4f62-9ef6-8356d3beb14b"}]} {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 03:06:13.365377 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-36f12272-734e-408b-b648-2c43b9d67ec0 tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 03:06:13.365833 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-36f12272-734e-408b-b648-2c43b9d67ec0 tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 03:06:13.366891 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-36f12272-734e-408b-b648-2c43b9d67ec0 tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 03:06:13.367330 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-36f12272-734e-408b-b648-2c43b9d67ec0 tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 03:06:13.370929 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [req-34f1d8d0-1071-4ffb-a884-9751d354bb04 req-2988a804-e212-492e-9e85-cf9290c4caa3 service nova] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 03:06:13.371510 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [req-34f1d8d0-1071-4ffb-a884-9751d354bb04 req-2988a804-e212-492e-9e85-cf9290c4caa3 service nova] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 03:06:13.381784 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.compute.server_external_events [req-34f1d8d0-1071-4ffb-a884-9751d354bb04 req-2988a804-e212-492e-9e85-cf9290c4caa3 service nova] Creating event network-changed:7a3f6fd1-71aa-4f62-9ef6-8356d3beb14b for instance 09c20a20-b88c-4af5-b7d8-78b500009499 on hv-cinder-82725 Mar 05 03:06:13.387663 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [req-34f1d8d0-1071-4ffb-a884-9751d354bb04 req-2988a804-e212-492e-9e85-cf9290c4caa3 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031468 Mar 05 03:06:13.388845 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 458/930] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Mar 5 03:06:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 05 03:06:13.393840 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-36f12272-734e-408b-b648-2c43b9d67ec0 tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] [instance: 09c20a20-b88c-4af5-b7d8-78b500009499] Going to try to terminate instance {{(pid=123545) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 05 03:06:13.480160 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-36f12272-734e-408b-b648-2c43b9d67ec0 tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] 10.222.0.26 "DELETE /compute/v2.1/servers/09c20a20-b88c-4af5-b7d8-78b500009499" status: 204 len: 0 microversion: 2.1 time: 0.126151 Mar 05 03:06:13.483876 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 473/931] 10.222.0.26 () {58 vars in 1238 bytes} [Sat Mar 5 03:06:13 2022] DELETE /compute/v2.1/servers/09c20a20-b88c-4af5-b7d8-78b500009499 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 05 03:06:13.491872 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-5104b055-1970-4745-b538-85db04070819 tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 03:06:13.491872 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-5104b055-1970-4745-b538-85db04070819 tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] [instance: 09c20a20-b88c-4af5-b7d8-78b500009499] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 03:06:13.499032 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-5104b055-1970-4745-b538-85db04070819 tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 03:06:13.499519 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-5104b055-1970-4745-b538-85db04070819 tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 03:06:13.500301 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-5104b055-1970-4745-b538-85db04070819 tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 03:06:13.500740 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-5104b055-1970-4745-b538-85db04070819 tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 03:06:13.726173 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-5104b055-1970-4745-b538-85db04070819 tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53fb7a6cf8b4d47a871ee2a1a24d21f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e08e745e374d92a13f0a03ad69b496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 03:06:13.730717 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-5104b055-1970-4745-b538-85db04070819 tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] 10.222.0.26 "GET /compute/v2.1/servers/09c20a20-b88c-4af5-b7d8-78b500009499" status: 200 len: 1580 microversion: 2.1 time: 0.244531 Mar 05 03:06:13.731325 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 459/932] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 03:06:13 2022] GET /compute/v2.1/servers/09c20a20-b88c-4af5-b7d8-78b500009499 => generated 1580 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 03:06:14.748686 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-2855c771-4fdf-4562-a8f8-74682aea76b8 tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 03:06:14.749443 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-2855c771-4fdf-4562-a8f8-74682aea76b8 tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] [instance: 09c20a20-b88c-4af5-b7d8-78b500009499] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 03:06:14.755726 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-2855c771-4fdf-4562-a8f8-74682aea76b8 tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 03:06:14.756169 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-2855c771-4fdf-4562-a8f8-74682aea76b8 tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 03:06:14.756931 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-2855c771-4fdf-4562-a8f8-74682aea76b8 tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 03:06:14.757361 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-2855c771-4fdf-4562-a8f8-74682aea76b8 tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 03:06:15.235410 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-2855c771-4fdf-4562-a8f8-74682aea76b8 tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53fb7a6cf8b4d47a871ee2a1a24d21f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e08e745e374d92a13f0a03ad69b496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 03:06:15.242689 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-2855c771-4fdf-4562-a8f8-74682aea76b8 tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] 10.222.0.26 "GET /compute/v2.1/servers/09c20a20-b88c-4af5-b7d8-78b500009499" status: 200 len: 1461 microversion: 2.1 time: 0.498349 Mar 05 03:06:15.243252 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 474/933] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 03:06:14 2022] GET /compute/v2.1/servers/09c20a20-b88c-4af5-b7d8-78b500009499 => generated 1461 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 03:06:15.575015 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [req-b5d9550b-3ec9-4cf4-ac46-218a81d1d10a req-70abe28e-ed81-487a-9e48-735828b1d11b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "09c20a20-b88c-4af5-b7d8-78b500009499", "name": "network-vif-deleted", "tag": "7a3f6fd1-71aa-4f62-9ef6-8356d3beb14b"}]} {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 03:06:15.584954 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [req-b5d9550b-3ec9-4cf4-ac46-218a81d1d10a req-70abe28e-ed81-487a-9e48-735828b1d11b service nova] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 03:06:15.585926 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [req-b5d9550b-3ec9-4cf4-ac46-218a81d1d10a req-70abe28e-ed81-487a-9e48-735828b1d11b service nova] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 03:06:15.597948 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.compute.server_external_events [req-b5d9550b-3ec9-4cf4-ac46-218a81d1d10a req-70abe28e-ed81-487a-9e48-735828b1d11b service nova] Creating event network-vif-deleted:7a3f6fd1-71aa-4f62-9ef6-8356d3beb14b for instance 09c20a20-b88c-4af5-b7d8-78b500009499 on hv-cinder-82725 Mar 05 03:06:15.603700 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [req-b5d9550b-3ec9-4cf4-ac46-218a81d1d10a req-70abe28e-ed81-487a-9e48-735828b1d11b service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032428 Mar 05 03:06:15.604299 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 460/934] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Mar 5 03:06:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 03:06:16.260854 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-085723e3-7c0e-4fb2-a91d-104d518d7610 tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 03:06:16.261658 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-085723e3-7c0e-4fb2-a91d-104d518d7610 tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] [instance: 09c20a20-b88c-4af5-b7d8-78b500009499] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 03:06:16.268646 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-085723e3-7c0e-4fb2-a91d-104d518d7610 tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 03:06:16.269117 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-085723e3-7c0e-4fb2-a91d-104d518d7610 tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 03:06:16.269899 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-085723e3-7c0e-4fb2-a91d-104d518d7610 tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 03:06:16.270372 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-085723e3-7c0e-4fb2-a91d-104d518d7610 tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 03:06:16.283990 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.wsgi [None req-085723e3-7c0e-4fb2-a91d-104d518d7610 tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] HTTP exception thrown: Instance 09c20a20-b88c-4af5-b7d8-78b500009499 could not be found. Mar 05 03:06:16.284590 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-085723e3-7c0e-4fb2-a91d-104d518d7610 tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Returning 404 to user: Instance 09c20a20-b88c-4af5-b7d8-78b500009499 could not be found. {{(pid=123545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 03:06:16.285421 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-085723e3-7c0e-4fb2-a91d-104d518d7610 tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] 10.222.0.26 "GET /compute/v2.1/servers/09c20a20-b88c-4af5-b7d8-78b500009499" status: 404 len: 111 microversion: 2.1 time: 0.028546 Mar 05 03:06:16.286060 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 475/935] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 03:06:16 2022] GET /compute/v2.1/servers/09c20a20-b88c-4af5-b7d8-78b500009499 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Mar 05 03:06:19.610309 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-b093d030-5153-4497-b943-601b58d22389 tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 03:06:19.610900 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-b093d030-5153-4497-b943-601b58d22389 tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] [instance: ad51225a-4c41-4a81-958b-6a46d1a7759d] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 03:06:19.617722 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-b093d030-5153-4497-b943-601b58d22389 tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 03:06:19.618219 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-b093d030-5153-4497-b943-601b58d22389 tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 03:06:19.619002 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-b093d030-5153-4497-b943-601b58d22389 tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 03:06:19.619448 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-b093d030-5153-4497-b943-601b58d22389 tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 03:06:19.645611 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-b093d030-5153-4497-b943-601b58d22389 tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] [instance: ad51225a-4c41-4a81-958b-6a46d1a7759d] Going to try to terminate instance {{(pid=123546) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 05 03:06:19.704979 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [req-52326379-3365-4b62-bd57-2c2e8f49ceb8 req-fefe6e8c-381e-4f48-bd14-64dfa51ccbf7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ad51225a-4c41-4a81-958b-6a46d1a7759d", "tag": "646a8079-0c54-4aed-a880-792512b0748a"}]} {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 03:06:19.717322 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [req-52326379-3365-4b62-bd57-2c2e8f49ceb8 req-fefe6e8c-381e-4f48-bd14-64dfa51ccbf7 service nova] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 03:06:19.718666 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [req-52326379-3365-4b62-bd57-2c2e8f49ceb8 req-fefe6e8c-381e-4f48-bd14-64dfa51ccbf7 service nova] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 03:06:19.737984 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-b093d030-5153-4497-b943-601b58d22389 tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] 10.222.0.26 "DELETE /compute/v2.1/servers/ad51225a-4c41-4a81-958b-6a46d1a7759d" status: 204 len: 0 microversion: 2.1 time: 0.132171 Mar 05 03:06:19.741817 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 461/936] 10.222.0.26 () {58 vars in 1238 bytes} [Sat Mar 5 03:06:19 2022] DELETE /compute/v2.1/servers/ad51225a-4c41-4a81-958b-6a46d1a7759d => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 05 03:06:19.748221 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-aadea551-7c2a-4844-81d7-6b74f82fe57c tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 03:06:19.748935 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-aadea551-7c2a-4844-81d7-6b74f82fe57c tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] [instance: ad51225a-4c41-4a81-958b-6a46d1a7759d] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 03:06:19.754288 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.compute.server_external_events [req-52326379-3365-4b62-bd57-2c2e8f49ceb8 req-fefe6e8c-381e-4f48-bd14-64dfa51ccbf7 service nova] Creating event network-changed:646a8079-0c54-4aed-a880-792512b0748a for instance ad51225a-4c41-4a81-958b-6a46d1a7759d on hv-cinder-82725 Mar 05 03:06:19.755025 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-aadea551-7c2a-4844-81d7-6b74f82fe57c tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 03:06:19.755487 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-aadea551-7c2a-4844-81d7-6b74f82fe57c tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 03:06:19.756278 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-aadea551-7c2a-4844-81d7-6b74f82fe57c tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 03:06:19.756720 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-aadea551-7c2a-4844-81d7-6b74f82fe57c tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 03:06:19.760504 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [req-52326379-3365-4b62-bd57-2c2e8f49ceb8 req-fefe6e8c-381e-4f48-bd14-64dfa51ccbf7 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.151986 Mar 05 03:06:19.762576 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 476/937] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Mar 5 03:06:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 05 03:06:19.977531 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.policy [None req-aadea551-7c2a-4844-81d7-6b74f82fe57c tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53fb7a6cf8b4d47a871ee2a1a24d21f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e08e745e374d92a13f0a03ad69b496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123546) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 03:06:19.985945 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-aadea551-7c2a-4844-81d7-6b74f82fe57c tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] 10.222.0.26 "GET /compute/v2.1/servers/ad51225a-4c41-4a81-958b-6a46d1a7759d" status: 200 len: 1577 microversion: 2.1 time: 0.242785 Mar 05 03:06:19.986691 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 462/938] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 03:06:19 2022] GET /compute/v2.1/servers/ad51225a-4c41-4a81-958b-6a46d1a7759d => generated 1577 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 05 03:06:21.004872 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-c9f425ac-1e7d-42bc-8207-1c7d99a2500e tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 03:06:21.005571 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-c9f425ac-1e7d-42bc-8207-1c7d99a2500e tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] [instance: ad51225a-4c41-4a81-958b-6a46d1a7759d] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 03:06:21.013321 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-c9f425ac-1e7d-42bc-8207-1c7d99a2500e tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 03:06:21.013781 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-c9f425ac-1e7d-42bc-8207-1c7d99a2500e tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 03:06:21.014591 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-c9f425ac-1e7d-42bc-8207-1c7d99a2500e tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 03:06:21.015031 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-c9f425ac-1e7d-42bc-8207-1c7d99a2500e tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 03:06:21.151642 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-c9f425ac-1e7d-42bc-8207-1c7d99a2500e tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53fb7a6cf8b4d47a871ee2a1a24d21f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e08e745e374d92a13f0a03ad69b496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 03:06:21.159775 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-c9f425ac-1e7d-42bc-8207-1c7d99a2500e tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] 10.222.0.26 "GET /compute/v2.1/servers/ad51225a-4c41-4a81-958b-6a46d1a7759d" status: 200 len: 1459 microversion: 2.1 time: 0.159219 Mar 05 03:06:21.160359 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 477/939] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 03:06:20 2022] GET /compute/v2.1/servers/ad51225a-4c41-4a81-958b-6a46d1a7759d => generated 1459 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 03:06:21.679733 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [req-d72793a5-84ca-40e8-b682-311e0d44aea9 req-3f4eef93-c90f-4b64-9bed-3e356f5fa632 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad51225a-4c41-4a81-958b-6a46d1a7759d", "name": "network-vif-deleted", "tag": "646a8079-0c54-4aed-a880-792512b0748a"}]} {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 05 03:06:21.688877 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [req-d72793a5-84ca-40e8-b682-311e0d44aea9 req-3f4eef93-c90f-4b64-9bed-3e356f5fa632 service nova] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 03:06:21.689323 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [req-d72793a5-84ca-40e8-b682-311e0d44aea9 req-3f4eef93-c90f-4b64-9bed-3e356f5fa632 service nova] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 03:06:21.700636 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.compute.server_external_events [req-d72793a5-84ca-40e8-b682-311e0d44aea9 req-3f4eef93-c90f-4b64-9bed-3e356f5fa632 service nova] Creating event network-vif-deleted:646a8079-0c54-4aed-a880-792512b0748a for instance ad51225a-4c41-4a81-958b-6a46d1a7759d on hv-cinder-82725 Mar 05 03:06:21.706684 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [req-d72793a5-84ca-40e8-b682-311e0d44aea9 req-3f4eef93-c90f-4b64-9bed-3e356f5fa632 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030473 Mar 05 03:06:21.707286 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 463/940] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Mar 5 03:06:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 05 03:06:22.176678 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-f398284f-37a2-449b-abca-5a26ab29a148 tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 03:06:22.177300 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-f398284f-37a2-449b-abca-5a26ab29a148 tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] [instance: ad51225a-4c41-4a81-958b-6a46d1a7759d] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 03:06:22.183511 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-f398284f-37a2-449b-abca-5a26ab29a148 tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 03:06:22.184072 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-f398284f-37a2-449b-abca-5a26ab29a148 tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 03:06:22.184849 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-f398284f-37a2-449b-abca-5a26ab29a148 tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 03:06:22.185299 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-f398284f-37a2-449b-abca-5a26ab29a148 tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 03:06:22.217204 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-f398284f-37a2-449b-abca-5a26ab29a148 tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 03:06:22.217557 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-f398284f-37a2-449b-abca-5a26ab29a148 tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 03:06:22.218033 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.objects.instance [None req-f398284f-37a2-449b-abca-5a26ab29a148 tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Lazy-loading 'fault' on Instance uuid ad51225a-4c41-4a81-958b-6a46d1a7759d {{(pid=123545) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 05 03:06:22.259321 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.policy [None req-f398284f-37a2-449b-abca-5a26ab29a148 tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53fb7a6cf8b4d47a871ee2a1a24d21f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e08e745e374d92a13f0a03ad69b496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123545) authorize /opt/stack/nova/nova/policy.py:199}} Mar 05 03:06:22.267387 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-f398284f-37a2-449b-abca-5a26ab29a148 tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] 10.222.0.26 "GET /compute/v2.1/servers/ad51225a-4c41-4a81-958b-6a46d1a7759d" status: 200 len: 1230 microversion: 2.1 time: 0.094441 Mar 05 03:06:22.268062 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 478/941] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 03:06:22 2022] GET /compute/v2.1/servers/ad51225a-4c41-4a81-958b-6a46d1a7759d => generated 1230 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 05 03:06:23.285593 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-ce8fff8d-f67a-42a2-b03b-5b49a33f4617 tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 03:06:23.286306 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-ce8fff8d-f67a-42a2-b03b-5b49a33f4617 tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] [instance: ad51225a-4c41-4a81-958b-6a46d1a7759d] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 03:06:23.293453 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-ce8fff8d-f67a-42a2-b03b-5b49a33f4617 tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 03:06:23.293902 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-ce8fff8d-f67a-42a2-b03b-5b49a33f4617 tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 03:06:23.294699 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-ce8fff8d-f67a-42a2-b03b-5b49a33f4617 tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 03:06:23.295130 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-ce8fff8d-f67a-42a2-b03b-5b49a33f4617 tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 03:06:23.307655 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.wsgi [None req-ce8fff8d-f67a-42a2-b03b-5b49a33f4617 tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] HTTP exception thrown: Instance ad51225a-4c41-4a81-958b-6a46d1a7759d could not be found. Mar 05 03:06:23.309052 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-ce8fff8d-f67a-42a2-b03b-5b49a33f4617 tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Returning 404 to user: Instance ad51225a-4c41-4a81-958b-6a46d1a7759d could not be found. {{(pid=123546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 03:06:23.309854 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-ce8fff8d-f67a-42a2-b03b-5b49a33f4617 tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] 10.222.0.26 "GET /compute/v2.1/servers/ad51225a-4c41-4a81-958b-6a46d1a7759d" status: 404 len: 111 microversion: 2.1 time: 0.028508 Mar 05 03:06:23.310410 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 464/942] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 03:06:23 2022] GET /compute/v2.1/servers/ad51225a-4c41-4a81-958b-6a46d1a7759d => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 05 03:06:23.757480 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-094d4df3-5dca-4825-b8d3-3f9479c84933 tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Calling method '>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 03:06:23.758053 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.compute.api [None req-094d4df3-5dca-4825-b8d3-3f9479c84933 tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] [instance: 431b9c6e-48ce-4fa6-a266-cb5b04556cf1] Fetching instance by UUID {{(pid=123545) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 03:06:23.764221 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-094d4df3-5dca-4825-b8d3-3f9479c84933 tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 03:06:23.764712 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-094d4df3-5dca-4825-b8d3-3f9479c84933 tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 03:06:23.765418 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-094d4df3-5dca-4825-b8d3-3f9479c84933 tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 03:06:23.765848 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG oslo_concurrency.lockutils [None req-094d4df3-5dca-4825-b8d3-3f9479c84933 tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 03:06:23.778971 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.wsgi [None req-094d4df3-5dca-4825-b8d3-3f9479c84933 tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] HTTP exception thrown: Instance 431b9c6e-48ce-4fa6-a266-cb5b04556cf1 could not be found. Mar 05 03:06:23.779542 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-094d4df3-5dca-4825-b8d3-3f9479c84933 tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Returning 404 to user: Instance 431b9c6e-48ce-4fa6-a266-cb5b04556cf1 could not be found. {{(pid=123545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 03:06:23.780340 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-094d4df3-5dca-4825-b8d3-3f9479c84933 tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] 10.222.0.26 "DELETE /compute/v2.1/servers/431b9c6e-48ce-4fa6-a266-cb5b04556cf1" status: 404 len: 111 microversion: 2.1 time: 0.026834 Mar 05 03:06:23.780854 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 479/943] 10.222.0.26 () {58 vars in 1238 bytes} [Sat Mar 5 03:06:23 2022] DELETE /compute/v2.1/servers/431b9c6e-48ce-4fa6-a266-cb5b04556cf1 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 05 03:06:23.788937 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-a7ea9767-57c7-42df-83d1-9f9f5849d91a tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Calling method '>' {{(pid=123546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 03:06:23.789584 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.compute.api [None req-a7ea9767-57c7-42df-83d1-9f9f5849d91a tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] [instance: 431b9c6e-48ce-4fa6-a266-cb5b04556cf1] Fetching instance by UUID {{(pid=123546) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 05 03:06:23.796097 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-a7ea9767-57c7-42df-83d1-9f9f5849d91a tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 03:06:23.796549 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-a7ea9767-57c7-42df-83d1-9f9f5849d91a tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 03:06:23.797316 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-a7ea9767-57c7-42df-83d1-9f9f5849d91a tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 05 03:06:23.797751 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG oslo_concurrency.lockutils [None req-a7ea9767-57c7-42df-83d1-9f9f5849d91a tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Lock "9d368175-6627-4876-8662-d12827d1bbec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 05 03:06:23.810536 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.wsgi [None req-a7ea9767-57c7-42df-83d1-9f9f5849d91a tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] HTTP exception thrown: Instance 431b9c6e-48ce-4fa6-a266-cb5b04556cf1 could not be found. Mar 05 03:06:23.811111 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: DEBUG nova.api.openstack.wsgi [None req-a7ea9767-57c7-42df-83d1-9f9f5849d91a tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Returning 404 to user: Instance 431b9c6e-48ce-4fa6-a266-cb5b04556cf1 could not be found. {{(pid=123546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 05 03:06:23.811919 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO nova.api.openstack.requestlog [None req-a7ea9767-57c7-42df-83d1-9f9f5849d91a tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] 10.222.0.26 "GET /compute/v2.1/servers/431b9c6e-48ce-4fa6-a266-cb5b04556cf1" status: 404 len: 111 microversion: 2.1 time: 0.026908 Mar 05 03:06:23.812439 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: [pid: 123546|app: 0|req: 465/944] 10.222.0.26 () {58 vars in 1235 bytes} [Sat Mar 5 03:06:23 2022] GET /compute/v2.1/servers/431b9c6e-48ce-4fa6-a266-cb5b04556cf1 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 05 03:06:25.089642 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: DEBUG nova.api.openstack.wsgi [None req-f06f69e1-7a74-4273-ad89-62e58a1fcf5b tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] Calling method '.version_select at 0x7f3f61ccfc10>' {{(pid=123545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 05 03:06:25.108882 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO nova.api.openstack.requestlog [None req-f06f69e1-7a74-4273-ad89-62e58a1fcf5b tempest-TestVolumeBootPattern-2080675827 tempest-TestVolumeBootPattern-2080675827-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1345238013" status: 202 len: 0 microversion: 2.1 time: 0.023585 Mar 05 03:06:25.109563 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: [pid: 123545|app: 0|req: 480/945] 10.222.0.26 () {58 vars in 1262 bytes} [Sat Mar 5 03:06:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1345238013 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 05 03:07:28.126149 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 05 03:07:28.126882 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: Sat Mar 5 03:07:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 05 03:08:46.670510 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 05 03:08:46.671145 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: Sat Mar 5 03:08:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 05 03:08:59.850846 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 05 03:08:59.851521 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: Sat Mar 5 03:08:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 05 03:09:03.399487 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 05 03:09:03.400064 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: Sat Mar 5 03:09:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 05 03:09:24.202704 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 05 03:09:24.203398 dv-cinder-827259-3-iscsi devstack@n-api.service[123546]: Sat Mar 5 03:09:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 05 03:09:30.628063 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 05 03:09:30.628583 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: Sat Mar 5 03:09:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 05 03:10:48.134454 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 05 03:10:48.135155 dv-cinder-827259-3-iscsi devstack@n-api.service[123545]: Sat Mar 5 03:10:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!